-- Logs begin at Tue 2022-06-28 11:18:36 UTC, end at Tue 2022-06-28 12:35:35 UTC. -- Jun 28 11:54:13.083665 dv-cinder-847954-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 28 11:54:13.091318 dv-cinder-847954-1-smb devstack@keystone.service[80301]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 28 11:54:13 2022] *** Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: nodename: dv-cinder-847954-1-smb Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: machine: x86_64 Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: clock source: unix Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: pcre jit disabled Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: detected number of CPU cores: 4 Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: current working directory: / Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: detected binary path: /usr/bin/uwsgi-core Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: your processes number limit is 47680 Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: your memory page size is 4096 bytes Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: detected max file descriptor number: 2048 Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: lock engine: pthread robust mutexes Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: thunder lock: enabled Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 28 11:54:13.098041 dv-cinder-847954-1-smb devstack@keystone.service[80301]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 28 11:54:13.142838 dv-cinder-847954-1-smb devstack@keystone.service[80301]: Python main interpreter initialized at 0x5627f17ec9c0 Jun 28 11:54:13.142838 dv-cinder-847954-1-smb devstack@keystone.service[80301]: python threads support enabled Jun 28 11:54:13.142838 dv-cinder-847954-1-smb devstack@keystone.service[80301]: your server socket listen backlog is limited to 100 connections Jun 28 11:54:13.142838 dv-cinder-847954-1-smb devstack@keystone.service[80301]: your mercy for graceful operations on workers is 90 seconds Jun 28 11:54:13.143215 dv-cinder-847954-1-smb devstack@keystone.service[80301]: mapped 403077 bytes (393 KB) for 2 cores Jun 28 11:54:13.143292 dv-cinder-847954-1-smb devstack@keystone.service[80301]: *** Operational MODE: preforking *** Jun 28 11:54:13.143541 dv-cinder-847954-1-smb devstack@keystone.service[80301]: *** uWSGI is running in multiple interpreter mode *** Jun 28 11:54:13.143541 dv-cinder-847954-1-smb devstack@keystone.service[80301]: spawned uWSGI master process (pid: 80301) Jun 28 11:54:13.143751 dv-cinder-847954-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 28 11:54:13.144901 dv-cinder-847954-1-smb devstack@keystone.service[80301]: spawned uWSGI worker 1 (pid: 80314, cores: 1) Jun 28 11:54:13.144901 dv-cinder-847954-1-smb devstack@keystone.service[80301]: spawned uWSGI worker 2 (pid: 80315, cores: 1) Jun 28 11:54:13.144901 dv-cinder-847954-1-smb devstack@keystone.service[80301]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 28 11:54:18.649073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 11:54:18.649073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: from cryptography.utils import int_from_bytes Jun 28 11:54:18.649832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 11:54:18.649832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jun 28 11:54:18.650250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 11:54:18.650250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: from cryptography.utils import int_from_bytes Jun 28 11:54:18.650359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 11:54:18.650359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jun 28 11:54:18.698336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 11:54:18.698540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 11:54:18.698675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 11:54:18.698777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] command line args: [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 11:54:18.698863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 11:54:18.698991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 11:54:18.699069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] command line args: [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 11:54:18.699169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ================================================================================ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 11:54:18.699331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 11:54:18.699415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] admin_token = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.699517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ================================================================================ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 11:54:18.699667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] config_dir = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.699776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.699857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] config_source = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_dir = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] debug = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_source = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] debug = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.700954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.701135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.701247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.701339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.701436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.701530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.701627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.701733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.701834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] log_config_append = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.701931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_config_append = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] log_dir = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702319 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] log_file = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_dir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.702999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.703120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.703239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.703322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.703392 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.703473 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.703550 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.703626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.703757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.703926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.704015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.704089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.704246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.704325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.704475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.704551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.704709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.704786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.704939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.705015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.705174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.705258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.705418 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.705495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.705666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.705749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.705944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.706174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.706354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] publish_errors = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.706432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.706594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.706708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] publish_errors = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.706803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.706878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.707045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.707159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.707244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.707315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.707429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.707507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.707663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] standard_threads = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.707740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.707918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] standard_threads = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] use_journal = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] use_json = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_journal = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] use_stderr = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708869 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_json = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.708971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] use_syslog = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.709049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_stderr = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.709197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_syslog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.709329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.709531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 11:54:18.709664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.709664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.709911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.709911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.710157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.710157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.710946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.710946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.711303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.711432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.711559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.711696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.711826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.711826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.712842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.713000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.713082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.713236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.713317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.713479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.713712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.713798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.713950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.714033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.714203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.714279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.714447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.714522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.714683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.714768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.714921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.714996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.715176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.715259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.715424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.715573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.715671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.715747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.715928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.716008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.716160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.716247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.716389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.716465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.716620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.716694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.716860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.716945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.717101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.717176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.717329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.717406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.717558 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.717642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.717789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.717863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.718035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.718114 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.718268 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.718355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.718504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.718580 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.718731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.718805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.718963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.719047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.719195 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.719272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.719423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.719513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.719652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.719738 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.719897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.719986 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.720129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.720232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.720584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.720700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.720795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.720894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.720894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721578 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.721995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.722149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.722271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.722384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.722468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.722620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.722704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.722850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.722925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.723085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.723165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.723317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.723393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.723547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.723623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.723776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.723852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.724039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.724113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.724274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.724357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.724514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.724600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.724751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.724828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.724995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.725072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.725231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.725308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.725468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.725546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.725703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.725780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.725940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.726913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.726913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.727074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.727156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.727228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.727297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.727461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.727613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.727686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.727755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.727935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.728017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.728185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.728281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.728421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.728498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.728654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.728727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.728894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.728980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.729128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.729206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.729362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.729442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.729596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.729673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.729828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.729907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.730328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.730410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.730567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.730644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.730805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.730884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.731043 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.731118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.731280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.731356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.731519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.731597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.731752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.731829 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.732007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.732094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.732240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.732318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.732471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.732547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.732699 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.732781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.732928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.733012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.733160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.733244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.733386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.733462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.733621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.733698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.733851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.733926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.734091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.734173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.734333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.734410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.734587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.734662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.734825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.734901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.735076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.735152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.735312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.external = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.735390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.735542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.735619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.735789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.external = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.735885 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.736049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.736157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.736300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.password = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.736384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.736531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] auth.token = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.736614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.736769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.736854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.password = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.737006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.737091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.token = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.737246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.737329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.737473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.737550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.737718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.737796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.737949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.738025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.738179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.738256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.738413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.738491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.738654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.738730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.738894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.738972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.739137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.739212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.739373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.739457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.739614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.739693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.739847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.739956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.740116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.740199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.740355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.740434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.740597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.740673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.740848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.740925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.741095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.741173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.741351 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.741428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.741627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.741783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.741905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.741989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.742169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.742353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.742465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.742594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.742679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.742832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.742912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.743079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.743173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.743338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.743491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.743626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.743753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.743906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.744029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.744167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.744294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.744420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.744555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.744675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.744799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.744932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.745057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.745192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.745318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.745453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.745578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.745711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.745836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.745961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.746085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.746210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.746334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.746466 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.746592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.746717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.746842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.746967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.747100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.747233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.747362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.747487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.747611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.747735 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.747861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.748065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.748192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.748316 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.748440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.748564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.748688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.748828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.748965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.749090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.749214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.749338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.749462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.749594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.749720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.749844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.749949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.750113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.750237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.750370 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.750494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.750628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.750753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.750877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.751135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.751260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.751384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.751507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.751631 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.751763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.751902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.752041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.752176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.752302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.752436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.752568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.752693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.752818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.752942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.753067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.753200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.753333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.753458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.753582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.753706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.753830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.753955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.754096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.754223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.754347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.754476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.754594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.754718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.754850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.754975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.755099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.755225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.755348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.755470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.755598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.755721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.755854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.755992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.756125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.756252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.756387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.756512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.756636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.756760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.756883 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.757007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.757138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.757275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.757399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.757480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.757541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.757697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.757827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.757953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.758077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.758201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.758326 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.758450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.758581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.758707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.758831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.758955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.758955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.759198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.759331 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.759457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.759581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.759705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.759820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.759984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.760121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.760245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.760370 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.760494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.760619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.760742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.760875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.761009 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.761133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.761257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.761380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.761505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.761637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.761762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.761886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.762015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.762139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.762262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.762397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.762523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.762647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.762781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.762905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.763028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.763159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.763284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.763408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.763532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.763656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.763780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.763926 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.764048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.764169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.764289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.764419 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.764545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.764674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.764796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.764917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.765037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.765158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.765278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.765883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.766010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.766131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.766258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.766383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.766508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.766718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.766846 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.766972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.767096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.767228 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.767354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.767487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.767613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.767738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.767863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.768005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.768131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.768266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.768392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.768527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.768652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.768778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.768914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.769039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.769164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.769290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.769415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.769540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.769673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.769799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.769924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.770048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.770173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.770307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.770307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.770551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.770676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.770800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.770926 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] role.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.771049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.771181 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] role.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.771306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.771430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.771554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.771678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.771802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.771971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.772093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.772218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.772343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.772468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.772592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.772724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.773394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.773486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.773616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.773736 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.773981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.774119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.774246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.774380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.774510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.774634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.774759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.774891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.775017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.775149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.775275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.775401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.775526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.775526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.775770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.775914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.776046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.776172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.776296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.776296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.776544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.776668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.776793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.776916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.777048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.777174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.777299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.777424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.777548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.777701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.777830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.777957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.778081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.778207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.778328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.778453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.778592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.778716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.778840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.778965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.779090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.779213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.779356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.779483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.779608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.779732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.779856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.780032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.780168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.780295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.780420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.780545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] token.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.780670 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.780794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.780926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.781052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.781185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.781310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.781442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.781568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.781701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.781826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.781950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.782074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.782198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.782323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.782456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.782582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.782706 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.782839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.782964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.783088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.783221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.783346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.783471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.783596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.783720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.783844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.783999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784148 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784219 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.784964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785178 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785628 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785699 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785699 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.785894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.786974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 11:54:18.787471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 11:54:18.787471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 11:54:18.815817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.816078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.816305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.816388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.816602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.816831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.824842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.825506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.853686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.853912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.854294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.854528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.996158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:18.997293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.045114 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.045293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.045668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.045903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.110074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.110246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.110334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.110481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.110567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.110704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.110788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.110920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.111004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.111131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.111212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.111341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.137287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.137443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.137598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.137677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.137771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.137985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.138070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.138206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.138347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.138428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.138626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.138716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.139047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.139383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.150417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.150947 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.162977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.163205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.163371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.163460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.163661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.163795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.163929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.164009 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.164261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.164411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.164550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.164674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80314) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.164811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.164811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 11:54:19.181601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.181808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 11:54:19.182104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.182231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.182354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 11:54:19.182483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 11:54:19.182606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.182741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.182871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.182998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 11:54:19.183142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.183270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.183397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.183531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.183658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.183811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.194058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.194335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.194603 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.195214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.195407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.195548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.195769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.196078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.203744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.204412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.207018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.207294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.207569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.207706 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.207831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.208001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.208135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.208265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.208403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.208531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.208657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.208783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.208909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.209035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.209171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.209299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.209435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.209561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.209687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.209828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.210038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.210307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.237198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.238095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.238803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.239077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.239711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.240013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.244616 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.245005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.245287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.245411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.245692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.245977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.252575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.252855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.253291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.253572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.257891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.258385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.258585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.258713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.258870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.258995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.259153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.259287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.259436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.259561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.259717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.259841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.259991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.260129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.260254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.260524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.279468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.279742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.279958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.280128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.284460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.284831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.288089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.288521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.288656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.288917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.293799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.293929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.297462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.297607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.301076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.301227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.301377 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.301504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.301637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.301761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.301916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.302042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.302193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.302328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.302477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.302619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.322057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.322253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.322408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.322551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.322691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.322828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.322972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.323107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.330720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.330868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.332439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.332575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.332717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.332847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.336482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.336635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.336771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.336917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.337051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.337193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.337339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.337481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.337622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.337755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.350761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.351068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.351581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.351732 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.352085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.352215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.352343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.352486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.353401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.353629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.353761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.353939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.354094 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.354248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.372676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.372984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.375942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.376296 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.379229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.379595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.380982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.381366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.382651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.382913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.383151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.383291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.383422 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.383709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.390450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.391049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.392066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.392668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.395276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.395564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.395940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.396122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.396250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.396376 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.396605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.396883 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.405902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.406187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.406473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.406604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.406893 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.407183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.415129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80314) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.415402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.415676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.415758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 11:54:19.415974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.416059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.416243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.416545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.416545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.416692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.416768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.416886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.417144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.417228 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.417410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.417499 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.417691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.417770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.417961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.418040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.418220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.418302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.418480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.418559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.418737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80314) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.418825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.419008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.419268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 11:54:19.456716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5627f17ec9c0 pid: 80314 (default app) Jun 28 11:54:19.457018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5627f17ec9c0 pid: 80315 (default app) Jun 28 11:54:19.460116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142846-2736-4148-bece-6b61566b7a69 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:19.460943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142846-2736-4148-bece-6b61566b7a69 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:19.461223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142846-2736-4148-bece-6b61566b7a69 None None] PATH_INFO: `/v3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:19.465444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Tue Jun 28 11:54:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:27.977011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb347e5-bf0e-449e-b855-4f673317c22e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:27.977591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb347e5-bf0e-449e-b855-4f673317c22e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:27.977591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb347e5-bf0e-449e-b855-4f673317c22e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:27.982196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:54:27.987941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:27.988372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:27.988491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:28.056716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: INFO dbcounter [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] Registered counter for database keystone Jun 28 11:54:28.078112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG oslo_db.sqlalchemy.engines [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:54:28.084222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writer thread running {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:54:28.259202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG passlib.handlers.bcrypt [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80314) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 28 11:54:28.259537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG passlib.handlers.bcrypt [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80314) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 28 11:54:28.313083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:28.314668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:28.434790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 28 11:54:28.592303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb347e5-bf0e-449e-b855-4f673317c22e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:28.664085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: INFO dbcounter [None req-8cb347e5-bf0e-449e-b855-4f673317c22e None None] Registered counter for database keystone Jun 28 11:54:28.739589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG oslo_db.sqlalchemy.engines [None req-8cb347e5-bf0e-449e-b855-4f673317c22e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 11:54:28.739589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writer thread running {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 11:54:28.809746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb347e5-bf0e-449e-b855-4f673317c22e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:28.813938 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb34c6-654d-44c8-84bc-baa8244c527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:28.814600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb34c6-654d-44c8-84bc-baa8244c527a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:28.814884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb34c6-654d-44c8-84bc-baa8244c527a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:28.815159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb34c6-654d-44c8-84bc-baa8244c527a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:28.823364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb34c6-654d-44c8-84bc-baa8244c527a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:28.874789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8beb34c6-654d-44c8-84bc-baa8244c527a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 28 11:54:28.875130 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb34c6-654d-44c8-84bc-baa8244c527a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:28.885258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Jun 28 11:54:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 11:54:28.891285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:28.905714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c847a4-4cfc-4993-ad1f-c9a6ea0e783b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:28.910186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86bd1f-f889-4858-a8d1-32ede3d01b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:28.911302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86bd1f-f889-4858-a8d1-32ede3d01b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:28.911588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86bd1f-f889-4858-a8d1-32ede3d01b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:28.911862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86bd1f-f889-4858-a8d1-32ede3d01b0f admin admin] PATH_INFO: `/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:28.916547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86bd1f-f889-4858-a8d1-32ede3d01b0f admin admin] RBAC: Authorizing `identity:get_project(project_id=34e93c67d4cd4a79a4295c88eb6ac57a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:28.966011 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7e86bd1f-f889-4858-a8d1-32ede3d01b0f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 28 11:54:28.966355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86bd1f-f889-4858-a8d1-32ede3d01b0f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:28.970920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Tue Jun 28 11:54:28 2022] GET /identity/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:30.989106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856c25-7fd8-4892-bee3-2863c02f2f95 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:30.989658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856c25-7fd8-4892-bee3-2863c02f2f95 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:30.989658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70856c25-7fd8-4892-bee3-2863c02f2f95 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:30.994457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:30.999894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a509a-67eb-4c0d-aac7-6eaa1be9639d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:31.000330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a509a-67eb-4c0d-aac7-6eaa1be9639d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:31.000483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a509a-67eb-4c0d-aac7-6eaa1be9639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:31.019481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f78a509a-67eb-4c0d-aac7-6eaa1be9639d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:31.021025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f78a509a-67eb-4c0d-aac7-6eaa1be9639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:31.029030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 28 11:54:31.051144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70856c25-7fd8-4892-bee3-2863c02f2f95 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:31.063964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70856c25-7fd8-4892-bee3-2863c02f2f95 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:31.068113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a42c4-c6f4-40d7-b261-d891ca7ae3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:31.068744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a42c4-c6f4-40d7-b261-d891ca7ae3ba admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:31.069026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a42c4-c6f4-40d7-b261-d891ca7ae3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:31.069334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a42c4-c6f4-40d7-b261-d891ca7ae3ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:31.076955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a42c4-c6f4-40d7-b261-d891ca7ae3ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:31.078724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a42c4-c6f4-40d7-b261-d891ca7ae3ba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:31.087409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Tue Jun 28 11:54:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 11:54:31.092773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a509a-67eb-4c0d-aac7-6eaa1be9639d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:31.102191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a509a-67eb-4c0d-aac7-6eaa1be9639d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:31.106827 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a73a8-e10c-48c3-90d9-8ed974aa8de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:31.107690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a73a8-e10c-48c3-90d9-8ed974aa8de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:31.108012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a73a8-e10c-48c3-90d9-8ed974aa8de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:31.108293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a73a8-e10c-48c3-90d9-8ed974aa8de1 admin admin] PATH_INFO: `/v3/users/5dacf821834c434a822a5d4f64c8fbf6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:31.109685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a73a8-e10c-48c3-90d9-8ed974aa8de1 admin admin] RBAC: Authorizing `identity:get_user(user_id=5dacf821834c434a822a5d4f64c8fbf6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:31.111522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a73a8-e10c-48c3-90d9-8ed974aa8de1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:31.113131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Tue Jun 28 11:54:31 2022] GET /identity/v3/users/5dacf821834c434a822a5d4f64c8fbf6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:33.189390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d6bfc-38e3-4549-99bc-bf28c572ef25 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.189929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d6bfc-38e3-4549-99bc-bf28c572ef25 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.189929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d6bfc-38e3-4549-99bc-bf28c572ef25 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.191287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:54:33.196706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50546c23-5c48-4510-99ec-ee500368395f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.197107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50546c23-5c48-4510-99ec-ee500368395f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.197273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50546c23-5c48-4510-99ec-ee500368395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.214148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-50546c23-5c48-4510-99ec-ee500368395f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:33.215329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-50546c23-5c48-4510-99ec-ee500368395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:33.231677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af9e20-0ce0-4491-8235-c852d0a0872f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.231987 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af9e20-0ce0-4491-8235-c852d0a0872f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.232264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af9e20-0ce0-4491-8235-c852d0a0872f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.233603 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:54:33.238577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0dcf-fe4a-4d66-9683-68c384b115a0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.238867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0dcf-fe4a-4d66-9683-68c384b115a0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.239149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0dcf-fe4a-4d66-9683-68c384b115a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.278917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-d37a0dcf-fe4a-4d66-9683-68c384b115a0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80315) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 28 11:54:33.279336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-d37a0dcf-fe4a-4d66-9683-68c384b115a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80315) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 28 11:54:33.297921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:33.321431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50546c23-5c48-4510-99ec-ee500368395f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:33.325912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d37a0dcf-fe4a-4d66-9683-68c384b115a0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:33.327526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d37a0dcf-fe4a-4d66-9683-68c384b115a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:33.344117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:33.424574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50546c23-5c48-4510-99ec-ee500368395f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:33.427290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:54:33.449995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a0dcf-fe4a-4d66-9683-68c384b115a0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:33.458863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961c715-54f6-4ab9-8f0a-fcf4520d81ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:33.459667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961c715-54f6-4ab9-8f0a-fcf4520d81ee None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.460008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961c715-54f6-4ab9-8f0a-fcf4520d81ee None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.460291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961c715-54f6-4ab9-8f0a-fcf4520d81ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.471459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961c715-54f6-4ab9-8f0a-fcf4520d81ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5961c715-54f6-4ab9-8f0a-fcf4520d81ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:33.483626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:33.484740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:54:33.485766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:54:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:54:33.490644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961c715-54f6-4ab9-8f0a-fcf4520d81ee None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:33.557443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a0dcf-fe4a-4d66-9683-68c384b115a0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:33.559703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:33.576432 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:33.593785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946761-02f1-4687-8906-91bb16aaadfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:33.593934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961c715-54f6-4ab9-8f0a-fcf4520d81ee None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:33.594683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946761-02f1-4687-8906-91bb16aaadfa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.594971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946761-02f1-4687-8906-91bb16aaadfa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.595250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946761-02f1-4687-8906-91bb16aaadfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.629294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe0ac7-e17e-42fa-9211-62bbf1c2af45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:33.629960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0ac7-e17e-42fa-9211-62bbf1c2af45 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.630243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0ac7-e17e-42fa-9211-62bbf1c2af45 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.630517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe0ac7-e17e-42fa-9211-62bbf1c2af45 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.631274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe0ac7-e17e-42fa-9211-62bbf1c2af45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:33.631579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe0ac7-e17e-42fa-9211-62bbf1c2af45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:33.633352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe0ac7-e17e-42fa-9211-62bbf1c2af45 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:33.644963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:33.651306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe0ac7-e17e-42fa-9211-62bbf1c2af45 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:33.667509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61946761-02f1-4687-8906-91bb16aaadfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:33.669085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61946761-02f1-4687-8906-91bb16aaadfa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:33.751536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe0ac7-e17e-42fa-9211-62bbf1c2af45 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:33.766525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 11:54:33.772859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946761-02f1-4687-8906-91bb16aaadfa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:33.775661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:33.786632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3742ae-b8de-45e1-ad1f-7d86d71dbe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:33.787665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3742ae-b8de-45e1-ad1f-7d86d71dbe26 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.788021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3742ae-b8de-45e1-ad1f-7d86d71dbe26 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.788839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3742ae-b8de-45e1-ad1f-7d86d71dbe26 None admin] PATH_INFO: `/v3/users/5dacf821834c434a822a5d4f64c8fbf6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.790194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3742ae-b8de-45e1-ad1f-7d86d71dbe26 None admin] RBAC: Authorizing `identity:get_user(user_id=5dacf821834c434a822a5d4f64c8fbf6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:33.791663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3742ae-b8de-45e1-ad1f-7d86d71dbe26 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:33.793331 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:33 2022] GET /identity/v3/users/5dacf821834c434a822a5d4f64c8fbf6 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:33.798618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3742ae-b8de-45e1-ad1f-7d86d71dbe26 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:33.812755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:33.872989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946761-02f1-4687-8906-91bb16aaadfa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:33.895656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3742ae-b8de-45e1-ad1f-7d86d71dbe26 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:33.906680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eede3-db09-42fe-8165-aa19bd4c0a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:33.907475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eede3-db09-42fe-8165-aa19bd4c0a37 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.907759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eede3-db09-42fe-8165-aa19bd4c0a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.908064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eede3-db09-42fe-8165-aa19bd4c0a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.928356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eede3-db09-42fe-8165-aa19bd4c0a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:33.929974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9eede3-db09-42fe-8165-aa19bd4c0a37 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:33.932929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc4089-af6e-42a7-bb85-ca7b9c903dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:33.933728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc4089-af6e-42a7-bb85-ca7b9c903dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:33.934015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc4089-af6e-42a7-bb85-ca7b9c903dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:33.934296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc4089-af6e-42a7-bb85-ca7b9c903dc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:33.935489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc4089-af6e-42a7-bb85-ca7b9c903dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:33.936987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc4089-af6e-42a7-bb85-ca7b9c903dc1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:33.938590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:33.944243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc4089-af6e-42a7-bb85-ca7b9c903dc1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1d9eede3-db09-42fe-8165-aa19bd4c0a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:54:33.950428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:33.951305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:33.952107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:54:33.952107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:54:33.952107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:54:33.952107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:33.952107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:54:33.957275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eede3-db09-42fe-8165-aa19bd4c0a37 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:34.013904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:34.029079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:34.047478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc4089-af6e-42a7-bb85-ca7b9c903dc1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:34.057782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eede3-db09-42fe-8165-aa19bd4c0a37 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:34.082193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03657-ef50-429c-912d-ca26aab7f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:34.082855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03657-ef50-429c-912d-ca26aab7f8af None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:34.083139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03657-ef50-429c-912d-ca26aab7f8af None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:34.083422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03657-ef50-429c-912d-ca26aab7f8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:34.084280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03657-ef50-429c-912d-ca26aab7f8af None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.domain.id=default, user.id=5dacf821834c434a822a5d4f64c8fbf6) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:34.084594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03657-ef50-429c-912d-ca26aab7f8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:34.086884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03657-ef50-429c-912d-ca26aab7f8af None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:34.091528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2e8ce-b78d-4704-adab-72387dab7a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:34.092220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2e8ce-b78d-4704-adab-72387dab7a6f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:34.092508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2e8ce-b78d-4704-adab-72387dab7a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:34.092785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2e8ce-b78d-4704-adab-72387dab7a6f None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:34.093519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2e8ce-b78d-4704-adab-72387dab7a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:34.093633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Jun 28 11:54:33 2022] GET /identity/v3/role_assignments?user.id=5dacf821834c434a822a5d4f64c8fbf6&scope.domain.id=default&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:34.093831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2e8ce-b78d-4704-adab-72387dab7a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:34.095212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2e8ce-b78d-4704-adab-72387dab7a6f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:34.114646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:36.349754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc844-126b-42b5-87a9-32276e34d84d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:36.350929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc844-126b-42b5-87a9-32276e34d84d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:36.351422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dc844-126b-42b5-87a9-32276e34d84d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:36.353391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:36.358594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad09d48-4688-445a-9914-ec622a82db23 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:36.359392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad09d48-4688-445a-9914-ec622a82db23 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:36.359918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad09d48-4688-445a-9914-ec622a82db23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:36.384832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dad09d48-4688-445a-9914-ec622a82db23 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:36.386337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dad09d48-4688-445a-9914-ec622a82db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:36.477477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:36.514113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dc844-126b-42b5-87a9-32276e34d84d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:36.656196 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dc844-126b-42b5-87a9-32276e34d84d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:36.703770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be361c-fdba-4407-a50f-3f49190b3805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:36.704965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be361c-fdba-4407-a50f-3f49190b3805 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:36.705467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be361c-fdba-4407-a50f-3f49190b3805 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:36.705936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be361c-fdba-4407-a50f-3f49190b3805 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:36.718142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36c727-eecd-43c9-aac6-c8d5bf474b49 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:36.718427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36c727-eecd-43c9-aac6-c8d5bf474b49 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:36.719028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36c727-eecd-43c9-aac6-c8d5bf474b49 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:36.720872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:36.727081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e506a-a8e8-4674-bbfa-4b1315241b97 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:36.727642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e506a-a8e8-4674-bbfa-4b1315241b97 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:36.728432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e506a-a8e8-4674-bbfa-4b1315241b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:36.728873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be361c-fdba-4407-a50f-3f49190b3805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-39be361c-fdba-4407-a50f-3f49190b3805 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:36.737129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:36.737981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:54:36.738724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 13/25] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:54:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:36.744756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be361c-fdba-4407-a50f-3f49190b3805 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:36.753020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:36.764888 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-099e506a-a8e8-4674-bbfa-4b1315241b97 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:36.766849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-099e506a-a8e8-4674-bbfa-4b1315241b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:36.840869 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:36.891082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 13/26] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:36.892445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b45070-c8b9-4935-a4f5-d1a3b3fe77ed None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:36.892733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b45070-c8b9-4935-a4f5-d1a3b3fe77ed None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:36.893010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b45070-c8b9-4935-a4f5-d1a3b3fe77ed None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:36.894259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:36.902786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15441fc3-b32d-4125-a52e-072bfa5ef0f6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:36.903073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15441fc3-b32d-4125-a52e-072bfa5ef0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:36.903346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15441fc3-b32d-4125-a52e-072bfa5ef0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:36.941662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-15441fc3-b32d-4125-a52e-072bfa5ef0f6 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:36.942790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-15441fc3-b32d-4125-a52e-072bfa5ef0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:36.967567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be361c-fdba-4407-a50f-3f49190b3805 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:37.035715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 15/28] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:37.036647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15441fc3-b32d-4125-a52e-072bfa5ef0f6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:37.044576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04425017-5663-42e1-9850-19ec84562e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:37.045267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04425017-5663-42e1-9850-19ec84562e28 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.045552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04425017-5663-42e1-9850-19ec84562e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.045826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04425017-5663-42e1-9850-19ec84562e28 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.046598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04425017-5663-42e1-9850-19ec84562e28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:37.046909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04425017-5663-42e1-9850-19ec84562e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:37.048332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04425017-5663-42e1-9850-19ec84562e28 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:37.065406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 14/29] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:37.072295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04425017-5663-42e1-9850-19ec84562e28 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:37.195132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:37.231830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15441fc3-b32d-4125-a52e-072bfa5ef0f6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:37.242868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:37.269705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04425017-5663-42e1-9850-19ec84562e28 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:37.272990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1e3ec-508c-453e-a8eb-fbaf00efd713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:37.274381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1e3ec-508c-453e-a8eb-fbaf00efd713 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.274933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1e3ec-508c-453e-a8eb-fbaf00efd713 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.275940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1e3ec-508c-453e-a8eb-fbaf00efd713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.288584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1e3ec-508c-453e-a8eb-fbaf00efd713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:37.290641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1e3ec-508c-453e-a8eb-fbaf00efd713 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-12b1e3ec-508c-453e-a8eb-fbaf00efd713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:54:37.312069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:37.312914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:37.313687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:54:37.313687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:54:37.313687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:54:37.313687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:37.313918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95e9f4-49ef-4f95-8bbc-03cf6bdab791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:37.313918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95e9f4-49ef-4f95-8bbc-03cf6bdab791 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.313918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95e9f4-49ef-4f95-8bbc-03cf6bdab791 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.314120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95e9f4-49ef-4f95-8bbc-03cf6bdab791 None admin] PATH_INFO: `/v3/users/5dacf821834c434a822a5d4f64c8fbf6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.320691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 16/30] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:37.320691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1e3ec-508c-453e-a8eb-fbaf00efd713 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:37.320897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95e9f4-49ef-4f95-8bbc-03cf6bdab791 None admin] RBAC: Authorizing `identity:get_user(user_id=5dacf821834c434a822a5d4f64c8fbf6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:37.320897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95e9f4-49ef-4f95-8bbc-03cf6bdab791 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:37.320897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 15/31] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:37 2022] GET /identity/v3/users/5dacf821834c434a822a5d4f64c8fbf6 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:37.322877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a879-93bc-42f1-b8d4-f9a5db40f071 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.322877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a879-93bc-42f1-b8d4-f9a5db40f071 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.322877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a879-93bc-42f1-b8d4-f9a5db40f071 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.324088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 16/32] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:37.324576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5a879-93bc-42f1-b8d4-f9a5db40f071 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:37.455218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1e3ec-508c-453e-a8eb-fbaf00efd713 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:37.468494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5a879-93bc-42f1-b8d4-f9a5db40f071 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:37.499075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb31837-49dc-45d2-b5cd-d9906e28dfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:37.500505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb31837-49dc-45d2-b5cd-d9906e28dfec None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.501080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb31837-49dc-45d2-b5cd-d9906e28dfec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.501509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb31837-49dc-45d2-b5cd-d9906e28dfec None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.502649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb31837-49dc-45d2-b5cd-d9906e28dfec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:37.504356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb31837-49dc-45d2-b5cd-d9906e28dfec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:37.520647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698ce2-0a83-4984-97c9-c681a744637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:37.521739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698ce2-0a83-4984-97c9-c681a744637e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.522335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698ce2-0a83-4984-97c9-c681a744637e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.523258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f698ce2-0a83-4984-97c9-c681a744637e None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.524007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698ce2-0a83-4984-97c9-c681a744637e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:37.524430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698ce2-0a83-4984-97c9-c681a744637e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:37.526101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f698ce2-0a83-4984-97c9-c681a744637e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:37.528383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:37.547617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 17/33] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:37.548819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698ce2-0a83-4984-97c9-c681a744637e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:37.674970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f698ce2-0a83-4984-97c9-c681a744637e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:37.710218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 17/34] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Jun 28 11:54:37 2022] POST /identity/v3/roles => generated 219 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:54:37.712120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7de07-01c7-44ee-a8c2-bfd5f1293396 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.712571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7de07-01c7-44ee-a8c2-bfd5f1293396 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.712860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7de07-01c7-44ee-a8c2-bfd5f1293396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.717924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e58ff-5336-4a0d-a61e-23abae1c87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:37.719217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e58ff-5336-4a0d-a61e-23abae1c87a5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.719720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e58ff-5336-4a0d-a61e-23abae1c87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.720186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e58ff-5336-4a0d-a61e-23abae1c87a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.721657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e58ff-5336-4a0d-a61e-23abae1c87a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:37.723248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e58ff-5336-4a0d-a61e-23abae1c87a5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:37.725000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 18/35] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:37.726401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e58ff-5336-4a0d-a61e-23abae1c87a5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:37.737005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f5c7de07-01c7-44ee-a8c2-bfd5f1293396 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:37.738635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f5c7de07-01c7-44ee-a8c2-bfd5f1293396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:37.763409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:37.820653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:37.827659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 18/36] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:37.829430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34efb73-b245-433a-b54c-2ae36141ce1a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.829929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34efb73-b245-433a-b54c-2ae36141ce1a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.830409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34efb73-b245-433a-b54c-2ae36141ce1a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.832214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 19/37] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:37.833312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34efb73-b245-433a-b54c-2ae36141ce1a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:37.878787 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e58ff-5336-4a0d-a61e-23abae1c87a5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:37.919627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567a0b-91b9-4e92-94b4-b4a887edffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:37.920357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567a0b-91b9-4e92-94b4-b4a887edffeb None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:37.920646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567a0b-91b9-4e92-94b4-b4a887edffeb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:37.921218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567a0b-91b9-4e92-94b4-b4a887edffeb None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:37.921645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc567a0b-91b9-4e92-94b4-b4a887edffeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:37.923109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc567a0b-91b9-4e92-94b4-b4a887edffeb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:37.968731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34efb73-b245-433a-b54c-2ae36141ce1a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:38.004504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3619e-71bb-4839-b63f-eb4574c81058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:38.005388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3619e-71bb-4839-b63f-eb4574c81058 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:38.005677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3619e-71bb-4839-b63f-eb4574c81058 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:38.005965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3619e-71bb-4839-b63f-eb4574c81058 None admin] PATH_INFO: `/v3/domains/default/users/5dacf821834c434a822a5d4f64c8fbf6/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:38.008631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3619e-71bb-4839-b63f-eb4574c81058 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5dacf821834c434a822a5d4f64c8fbf6, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:38.010304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3619e-71bb-4839-b63f-eb4574c81058 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:38.111896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 20/38] 10.222.0.49 () {58 vars in 1361 bytes} [Tue Jun 28 11:54:37 2022] PUT /identity/v3/domains/default/users/5dacf821834c434a822a5d4f64c8fbf6/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:54:38.111896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24f0d-36b4-4aa6-aa40-b1a52909a49a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:38.111896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24f0d-36b4-4aa6-aa40-b1a52909a49a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:38.111896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd24f0d-36b4-4aa6-aa40-b1a52909a49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:38.131400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-edd24f0d-36b4-4aa6-aa40-b1a52909a49a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:38.132943 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-edd24f0d-36b4-4aa6-aa40-b1a52909a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:38.136671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:38.152207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:54:37 2022] POST /identity/v3/projects => generated 301 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:54:38.152207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567a0b-91b9-4e92-94b4-b4a887edffeb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:38.240258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 21/40] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:38.245715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f217fe-2892-49a6-b02b-44a2691c71f7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:38.246010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f217fe-2892-49a6-b02b-44a2691c71f7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:38.246291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f217fe-2892-49a6-b02b-44a2691c71f7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:38.247900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 22/41] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:38.261989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f615-aa73-44dd-a0bf-e9ee12ec4ac4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:38.262184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f615-aa73-44dd-a0bf-e9ee12ec4ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:38.262411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f615-aa73-44dd-a0bf-e9ee12ec4ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:38.294099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1cc0f615-aa73-44dd-a0bf-e9ee12ec4ac4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:38.295714 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1cc0f615-aa73-44dd-a0bf-e9ee12ec4ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:38.304646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567a0b-91b9-4e92-94b4-b4a887edffeb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:38.321566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:38.344301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d731b-838b-4339-a3cc-b62a63f69292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:38.344992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d731b-838b-4339-a3cc-b62a63f69292 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:38.345282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d731b-838b-4339-a3cc-b62a63f69292 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:38.345564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d731b-838b-4339-a3cc-b62a63f69292 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:38.346452 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d731b-838b-4339-a3cc-b62a63f69292 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:38.348135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d731b-838b-4339-a3cc-b62a63f69292 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:38.375321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 23/42] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:54:38.376667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f615-aa73-44dd-a0bf-e9ee12ec4ac4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:38.442695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 20/43] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Jun 28 11:54:38 2022] POST /identity/v3/roles => generated 225 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:54:38.447981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d731b-838b-4339-a3cc-b62a63f69292 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:38.451489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:38.491818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f615-aa73-44dd-a0bf-e9ee12ec4ac4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:38.543252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c3ae5-b9aa-40c6-b63d-3da0e6aac7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:38.544280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c3ae5-b9aa-40c6-b63d-3da0e6aac7af None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:38.544872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c3ae5-b9aa-40c6-b63d-3da0e6aac7af None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:38.545328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c3ae5-b9aa-40c6-b63d-3da0e6aac7af None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:38.546384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c3ae5-b9aa-40c6-b63d-3da0e6aac7af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:38.548023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c3ae5-b9aa-40c6-b63d-3da0e6aac7af None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:38.585986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d731b-838b-4339-a3cc-b62a63f69292 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:38.622944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e38090-bc1e-4a9c-a4ed-767910d3b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:38.623754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e38090-bc1e-4a9c-a4ed-767910d3b8fe None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:38.624090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e38090-bc1e-4a9c-a4ed-767910d3b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:38.624372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e38090-bc1e-4a9c-a4ed-767910d3b8fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:38.625664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e38090-bc1e-4a9c-a4ed-767910d3b8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:38.627115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e38090-bc1e-4a9c-a4ed-767910d3b8fe None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:38.628951 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 21/44] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:38.634984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e38090-bc1e-4a9c-a4ed-767910d3b8fe None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:38.642578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 24/45] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Jun 28 11:54:38 2022] POST /identity/v3/roles => generated 223 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:54:38.795189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:38.856663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e38090-bc1e-4a9c-a4ed-767910d3b8fe None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:38.890736 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb188-b34d-4fcf-86e5-383f192fb640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:38.891402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb188-b34d-4fcf-86e5-383f192fb640 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:38.891686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb188-b34d-4fcf-86e5-383f192fb640 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:38.891995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb188-b34d-4fcf-86e5-383f192fb640 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:38.893088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bb188-b34d-4fcf-86e5-383f192fb640 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:38.894581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bb188-b34d-4fcf-86e5-383f192fb640 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:38.967491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 22/46] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:54:38 2022] POST /identity/v3/projects => generated 312 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 11:54:40.288776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf315a0-b775-40a9-9d57-d8908f780a25 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:40.289294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf315a0-b775-40a9-9d57-d8908f780a25 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:40.289405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf315a0-b775-40a9-9d57-d8908f780a25 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:40.290718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 25/47] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:40.296217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166390a-a693-4153-9480-851b82309429 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:40.296595 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166390a-a693-4153-9480-851b82309429 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:40.296885 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166390a-a693-4153-9480-851b82309429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:40.313621 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0166390a-a693-4153-9480-851b82309429 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:40.315129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0166390a-a693-4153-9480-851b82309429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:40.380594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:40.404203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf315a0-b775-40a9-9d57-d8908f780a25 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:40.507139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf315a0-b775-40a9-9d57-d8908f780a25 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:40.534657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:40.547978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ea887-a8a8-4da3-9114-8f7780a3b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:40.547978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ea887-a8a8-4da3-9114-8f7780a3b042 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:40.547978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ea887-a8a8-4da3-9114-8f7780a3b042 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:40.547978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ea887-a8a8-4da3-9114-8f7780a3b042 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:40.555532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ea887-a8a8-4da3-9114-8f7780a3b042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-533ea887-a8a8-4da3-9114-8f7780a3b042 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:40.564583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:40.565451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:40.566179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 26/49] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:54:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:40.573809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166390a-a693-4153-9480-851b82309429 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:40.598496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:40.674205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166390a-a693-4153-9480-851b82309429 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:40.707861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce469-26ab-424b-bf31-3bf7f494a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:40.708554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce469-26ab-424b-bf31-3bf7f494a617 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:40.708841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce469-26ab-424b-bf31-3bf7f494a617 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:40.709121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce469-26ab-424b-bf31-3bf7f494a617 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:40.709905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ce469-26ab-424b-bf31-3bf7f494a617 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:40.710218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ce469-26ab-424b-bf31-3bf7f494a617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:40.711609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ce469-26ab-424b-bf31-3bf7f494a617 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:40.719500 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 24/50] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:40.724970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ea887-a8a8-4da3-9114-8f7780a3b042 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:40.825697 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ea887-a8a8-4da3-9114-8f7780a3b042 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:40.868690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162392c9-f1b8-406c-8c21-cd6e1ac68cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:40.869561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162392c9-f1b8-406c-8c21-cd6e1ac68cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:40.869848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162392c9-f1b8-406c-8c21-cd6e1ac68cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:40.870128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162392c9-f1b8-406c-8c21-cd6e1ac68cc3 None admin] PATH_INFO: `/v3/users/5dacf821834c434a822a5d4f64c8fbf6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:40.871341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162392c9-f1b8-406c-8c21-cd6e1ac68cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=5dacf821834c434a822a5d4f64c8fbf6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:40.872849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162392c9-f1b8-406c-8c21-cd6e1ac68cc3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:40.874651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 27/51] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:40 2022] GET /identity/v3/users/5dacf821834c434a822a5d4f64c8fbf6 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:40.879831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce469-26ab-424b-bf31-3bf7f494a617 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:40.964710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:40.979989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce469-26ab-424b-bf31-3bf7f494a617 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:40.981756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20cc39-0d61-49b8-b2e6-006c1bdeccfd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:40.982058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20cc39-0d61-49b8-b2e6-006c1bdeccfd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:40.982359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20cc39-0d61-49b8-b2e6-006c1bdeccfd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:40.983737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 28/52] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:40.988689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f5c44-3a44-4c1c-8cb6-8da626386e8b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:40.988984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f5c44-3a44-4c1c-8cb6-8da626386e8b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:40.989268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f5c44-3a44-4c1c-8cb6-8da626386e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:41.007020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1f8f5c44-3a44-4c1c-8cb6-8da626386e8b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:41.008379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f8f5c44-3a44-4c1c-8cb6-8da626386e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:41.014252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab90b0-87c8-42de-b3dd-d9104a9043f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:41.015049 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab90b0-87c8-42de-b3dd-d9104a9043f7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:41.015335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab90b0-87c8-42de-b3dd-d9104a9043f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:41.015615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab90b0-87c8-42de-b3dd-d9104a9043f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:41.016828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab90b0-87c8-42de-b3dd-d9104a9043f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:41.018287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab90b0-87c8-42de-b3dd-d9104a9043f7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:41.019922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 25/53] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:41.026627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab90b0-87c8-42de-b3dd-d9104a9043f7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:41.063345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:41.085851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 29/54] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:54:41.105418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f5c44-3a44-4c1c-8cb6-8da626386e8b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:41.124967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab90b0-87c8-42de-b3dd-d9104a9043f7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:41.160006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569a337-2546-4f3e-85f4-27b69f2798ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:41.160707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a337-2546-4f3e-85f4-27b69f2798ba None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:41.160995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a337-2546-4f3e-85f4-27b69f2798ba None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:41.161276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a337-2546-4f3e-85f4-27b69f2798ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:41.162147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a337-2546-4f3e-85f4-27b69f2798ba None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.domain.id=default, user.id=5dacf821834c434a822a5d4f64c8fbf6) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:41.162465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a337-2546-4f3e-85f4-27b69f2798ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:41.164568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a337-2546-4f3e-85f4-27b69f2798ba None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:41.171504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 26/55] 10.222.0.49 () {56 vars in 1322 bytes} [Tue Jun 28 11:54:41 2022] GET /identity/v3/role_assignments?user.id=5dacf821834c434a822a5d4f64c8fbf6&scope.domain.id=default&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:41.315244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f5c44-3a44-4c1c-8cb6-8da626386e8b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:41.353722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e518b-b4bd-47a3-8112-26b479fe9236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:41.354727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e518b-b4bd-47a3-8112-26b479fe9236 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:41.355016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e518b-b4bd-47a3-8112-26b479fe9236 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:41.355297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e518b-b4bd-47a3-8112-26b479fe9236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:41.356502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e518b-b4bd-47a3-8112-26b479fe9236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:41.357967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e518b-b4bd-47a3-8112-26b479fe9236 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:41.360945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 30/56] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:41.365282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569a337-2546-4f3e-85f4-27b69f2798ba None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:41.386227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:41.465594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569a337-2546-4f3e-85f4-27b69f2798ba None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:41.498914 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb47d3-6eb8-40e0-b1a1-6ca1e1baee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:41.499572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb47d3-6eb8-40e0-b1a1-6ca1e1baee0f None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:41.499860 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb47d3-6eb8-40e0-b1a1-6ca1e1baee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:41.500169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb47d3-6eb8-40e0-b1a1-6ca1e1baee0f None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:41.500895 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb47d3-6eb8-40e0-b1a1-6ca1e1baee0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:41.502404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb47d3-6eb8-40e0-b1a1-6ca1e1baee0f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:41.583657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 27/57] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Jun 28 11:54:41 2022] POST /identity/v3/projects => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:54:43.612581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4b5c4-dc3e-421c-9945-d0bb7ab020e1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:43.613054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4b5c4-dc3e-421c-9945-d0bb7ab020e1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:43.613137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4b5c4-dc3e-421c-9945-d0bb7ab020e1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:43.614518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 31/58] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:43.619571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f2b1-6bc4-4dbe-8bae-8de0001dfb48 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:43.620035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f2b1-6bc4-4dbe-8bae-8de0001dfb48 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:43.620160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f2b1-6bc4-4dbe-8bae-8de0001dfb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:43.636589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4e87f2b1-6bc4-4dbe-8bae-8de0001dfb48 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:43.637771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4e87f2b1-6bc4-4dbe-8bae-8de0001dfb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:43.698217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:43.702552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 28/59] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:43.727711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4b5c4-dc3e-421c-9945-d0bb7ab020e1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:43.784417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:43.828318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4b5c4-dc3e-421c-9945-d0bb7ab020e1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:43.861850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114490ea-33cb-425e-ad89-8a5568cc757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:43.862637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114490ea-33cb-425e-ad89-8a5568cc757c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:43.862932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114490ea-33cb-425e-ad89-8a5568cc757c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:43.863212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114490ea-33cb-425e-ad89-8a5568cc757c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:43.864412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114490ea-33cb-425e-ad89-8a5568cc757c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:43.865966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114490ea-33cb-425e-ad89-8a5568cc757c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:43.867588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 32/60] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:43.873198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f2b1-6bc4-4dbe-8bae-8de0001dfb48 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:43.968435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f2b1-6bc4-4dbe-8bae-8de0001dfb48 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:44.000636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e1ce1-248f-449a-a45d-5dc0b3dc7421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:44.001304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1ce1-248f-449a-a45d-5dc0b3dc7421 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:44.001589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1ce1-248f-449a-a45d-5dc0b3dc7421 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:44.001866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1ce1-248f-449a-a45d-5dc0b3dc7421 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:44.002578 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e1ce1-248f-449a-a45d-5dc0b3dc7421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:44.004048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e1ce1-248f-449a-a45d-5dc0b3dc7421 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:44.142349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 29/61] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:54:43 2022] POST /identity/v3/users => generated 275 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:54:47.345727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f74ddb-3f47-46b1-b9fc-3cd920663c85 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.346582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f74ddb-3f47-46b1-b9fc-3cd920663c85 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.347041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f74ddb-3f47-46b1-b9fc-3cd920663c85 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.348578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 33/62] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:47.355252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd6ef2-625a-425a-a193-cff9262310ed None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.356167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd6ef2-625a-425a-a193-cff9262310ed None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.356590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd6ef2-625a-425a-a193-cff9262310ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.380853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-debd6ef2-625a-425a-a193-cff9262310ed None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:47.382490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-debd6ef2-625a-425a-a193-cff9262310ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:47.450624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:47.473526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 30/63] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:47.520477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f74ddb-3f47-46b1-b9fc-3cd920663c85 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:47.626955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20c88-2ad0-456c-979f-a3b8f61999d1 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.627616 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20c88-2ad0-456c-979f-a3b8f61999d1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.628137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20c88-2ad0-456c-979f-a3b8f61999d1 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.629719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 31/64] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:47.635899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee2e6-a476-4261-b951-bf1c2822da6c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.636439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee2e6-a476-4261-b951-bf1c2822da6c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.636932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee2e6-a476-4261-b951-bf1c2822da6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.656620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4efee2e6-a476-4261-b951-bf1c2822da6c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:47.658090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4efee2e6-a476-4261-b951-bf1c2822da6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:47.680756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f74ddb-3f47-46b1-b9fc-3cd920663c85 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:47.710196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:47.725639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6508297-be96-4269-9a58-66b3ba93c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:47.726970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508297-be96-4269-9a58-66b3ba93c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.727269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508297-be96-4269-9a58-66b3ba93c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.727802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508297-be96-4269-9a58-66b3ba93c0d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.736264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 32/65] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:54:47.741275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6508297-be96-4269-9a58-66b3ba93c0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:47.742358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471c08-7821-418e-97d1-431562104fc4 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.742750 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471c08-7821-418e-97d1-431562104fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.743130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471c08-7821-418e-97d1-431562104fc4 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.744600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 33/66] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:47.745868 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44631-124b-4686-b587-06505deac1aa None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.746529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44631-124b-4686-b587-06505deac1aa None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.747001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a44631-124b-4686-b587-06505deac1aa None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.748545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 34/67] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:47.750428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10b62-1677-49ac-becc-eb4fd53cb4c2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c6508297-be96-4269-9a58-66b3ba93c0d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:47.750530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:47.751301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:47.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 34/68] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:47.752691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10b62-1677-49ac-becc-eb4fd53cb4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.752691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e10b62-1677-49ac-becc-eb4fd53cb4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.760689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96035afd-11fd-4606-9f73-b8d65b549538 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.760982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96035afd-11fd-4606-9f73-b8d65b549538 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.761267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96035afd-11fd-4606-9f73-b8d65b549538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.780776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-96035afd-11fd-4606-9f73-b8d65b549538 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:47.781618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-97e10b62-1677-49ac-becc-eb4fd53cb4c2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:47.781991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-96035afd-11fd-4606-9f73-b8d65b549538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:47.782805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-97e10b62-1677-49ac-becc-eb4fd53cb4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:47.855162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 35/69] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:47.856312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10b62-1677-49ac-becc-eb4fd53cb4c2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:47.862720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 35/70] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:54:47.863699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96035afd-11fd-4606-9f73-b8d65b549538 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:47.910565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:47.962519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96035afd-11fd-4606-9f73-b8d65b549538 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:47.962723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e10b62-1677-49ac-becc-eb4fd53cb4c2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:47.976036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:47.996974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed04f4-baf1-42e3-9714-fc89813d0344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:47.997131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ef891-2de3-452b-8e2f-215ae70f2c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:47.997648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed04f4-baf1-42e3-9714-fc89813d0344 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.997861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef891-2de3-452b-8e2f-215ae70f2c5b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:47.997972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed04f4-baf1-42e3-9714-fc89813d0344 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.998146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef891-2de3-452b-8e2f-215ae70f2c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:47.998232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed04f4-baf1-42e3-9714-fc89813d0344 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.998420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef891-2de3-452b-8e2f-215ae70f2c5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:47.998941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed04f4-baf1-42e3-9714-fc89813d0344 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:47.999248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed04f4-baf1-42e3-9714-fc89813d0344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:47.999594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ef891-2de3-452b-8e2f-215ae70f2c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:48.000682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed04f4-baf1-42e3-9714-fc89813d0344 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:48.001097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ef891-2de3-452b-8e2f-215ae70f2c5b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:48.002882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:48.003970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95256f9-7fcf-44ab-a669-b02d555e27be None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.004649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95256f9-7fcf-44ab-a669-b02d555e27be None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.005266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95256f9-7fcf-44ab-a669-b02d555e27be None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.007968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 37/72] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:48.008375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95256f9-7fcf-44ab-a669-b02d555e27be None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.016321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:54:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:48.016321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed04f4-baf1-42e3-9714-fc89813d0344 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.110714 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95256f9-7fcf-44ab-a669-b02d555e27be None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:48.111136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed04f4-baf1-42e3-9714-fc89813d0344 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:48.120129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:48.143491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec17939-e8e1-4f68-87c6-413212983788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:48.143681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945900d-6d8a-4928-90eb-6d4eb3afa3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:48.144342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17939-e8e1-4f68-87c6-413212983788 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.144439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945900d-6d8a-4928-90eb-6d4eb3afa3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.144629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17939-e8e1-4f68-87c6-413212983788 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.144714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945900d-6d8a-4928-90eb-6d4eb3afa3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.144902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17939-e8e1-4f68-87c6-413212983788 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.144989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945900d-6d8a-4928-90eb-6d4eb3afa3d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.155548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec17939-e8e1-4f68-87c6-413212983788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:48.156011 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945900d-6d8a-4928-90eb-6d4eb3afa3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-d945900d-6d8a-4928-90eb-6d4eb3afa3d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:48.164258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:48.165085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:48.165824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6ec17939-e8e1-4f68-87c6-413212983788 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:48.166418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:48.167176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:54:48.168707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:48.170090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 37/74] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:48.170407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 38/75] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:48.170407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb432a-b156-4560-abc2-40cab1364917 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.170407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb432a-b156-4560-abc2-40cab1364917 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.170407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb432a-b156-4560-abc2-40cab1364917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.170866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945900d-6d8a-4928-90eb-6d4eb3afa3d4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.185560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6abb432a-b156-4560-abc2-40cab1364917 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:48.186781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6abb432a-b156-4560-abc2-40cab1364917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:48.221047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:48.253320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 39/76] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:48.254150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb432a-b156-4560-abc2-40cab1364917 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.273379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945900d-6d8a-4928-90eb-6d4eb3afa3d4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:48.308687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cffd77-f746-4650-aafa-db96b02cf8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:48.309373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cffd77-f746-4650-aafa-db96b02cf8a2 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.309662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cffd77-f746-4650-aafa-db96b02cf8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.309972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cffd77-f746-4650-aafa-db96b02cf8a2 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.310707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cffd77-f746-4650-aafa-db96b02cf8a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:48.312295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cffd77-f746-4650-aafa-db96b02cf8a2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:48.353943 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb432a-b156-4560-abc2-40cab1364917 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:48.386952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c9f00-90a4-4a44-8bba-d210919d8262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:48.387829 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c9f00-90a4-4a44-8bba-d210919d8262 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.388138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c9f00-90a4-4a44-8bba-d210919d8262 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.388411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c9f00-90a4-4a44-8bba-d210919d8262 None admin] PATH_INFO: `/v3/users/f20f5723be9f401d87512332d772d548` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.392639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 38/77] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:54:48 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:54:48.393479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cffd77-f746-4650-aafa-db96b02cf8a2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.404172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c9f00-90a4-4a44-8bba-d210919d8262 None admin] RBAC: Authorizing `identity:get_user(user_id=f20f5723be9f401d87512332d772d548)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:48.405706 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c9f00-90a4-4a44-8bba-d210919d8262 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:48.412035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 40/78] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/users/f20f5723be9f401d87512332d772d548 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:48.412035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c9f00-90a4-4a44-8bba-d210919d8262 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.424760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:48.456386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:48.524159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c9f00-90a4-4a44-8bba-d210919d8262 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:48.559653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cffd77-f746-4650-aafa-db96b02cf8a2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:48.564249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79fc65-37e4-4989-9dc3-f1f897761114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:48.564935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79fc65-37e4-4989-9dc3-f1f897761114 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.565229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79fc65-37e4-4989-9dc3-f1f897761114 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.565512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79fc65-37e4-4989-9dc3-f1f897761114 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.566283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79fc65-37e4-4989-9dc3-f1f897761114 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:48.566604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79fc65-37e4-4989-9dc3-f1f897761114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:48.568085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79fc65-37e4-4989-9dc3-f1f897761114 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:48.581185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 41/79] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:48.581856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79fc65-37e4-4989-9dc3-f1f897761114 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.602433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81baf5f-3622-4b83-93e2-a7b2c1431755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:48.603634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81baf5f-3622-4b83-93e2-a7b2c1431755 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.603634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81baf5f-3622-4b83-93e2-a7b2c1431755 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.603634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81baf5f-3622-4b83-93e2-a7b2c1431755 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.604594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81baf5f-3622-4b83-93e2-a7b2c1431755 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:48.606371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81baf5f-3622-4b83-93e2-a7b2c1431755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:48.606371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81baf5f-3622-4b83-93e2-a7b2c1431755 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:48.615215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 39/80] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:48.616214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81baf5f-3622-4b83-93e2-a7b2c1431755 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.702275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:48.718477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79fc65-37e4-4989-9dc3-f1f897761114 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:48.729537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:48.747599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81baf5f-3622-4b83-93e2-a7b2c1431755 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:48.763238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76fee-70df-4ae7-a01c-a497f6898498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:48.764328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76fee-70df-4ae7-a01c-a497f6898498 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.764615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76fee-70df-4ae7-a01c-a497f6898498 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.764892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76fee-70df-4ae7-a01c-a497f6898498 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.777541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d76fee-70df-4ae7-a01c-a497f6898498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f7d76fee-70df-4ae7-a01c-a497f6898498 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:48.785209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:48.786070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:48.786804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 42/81] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:48.788041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76fee-70df-4ae7-a01c-a497f6898498 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.798717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483da819-0aa7-4acd-a804-a7dccf9d28c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:48.799858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483da819-0aa7-4acd-a804-a7dccf9d28c4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.800208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483da819-0aa7-4acd-a804-a7dccf9d28c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.800488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483da819-0aa7-4acd-a804-a7dccf9d28c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.881100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483da819-0aa7-4acd-a804-a7dccf9d28c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:48.882943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483da819-0aa7-4acd-a804-a7dccf9d28c4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:48.933934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76fee-70df-4ae7-a01c-a497f6898498 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:48.976718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee40e9f-3221-46c4-b3da-a5f49bf7dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:48.977521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee40e9f-3221-46c4-b3da-a5f49bf7dacc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:48.977806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee40e9f-3221-46c4-b3da-a5f49bf7dacc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:48.978086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee40e9f-3221-46c4-b3da-a5f49bf7dacc None admin] PATH_INFO: `/v3/users/f20f5723be9f401d87512332d772d548` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:48.978415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:48.979550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee40e9f-3221-46c4-b3da-a5f49bf7dacc None admin] RBAC: Authorizing `identity:get_user(user_id=f20f5723be9f401d87512332d772d548)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:48.981142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee40e9f-3221-46c4-b3da-a5f49bf7dacc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:48.982830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 43/82] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/users/f20f5723be9f401d87512332d772d548 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:48.983594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee40e9f-3221-46c4-b3da-a5f49bf7dacc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:48.997227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 40/83] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:54:48.998658 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483da819-0aa7-4acd-a804-a7dccf9d28c4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:49.009801 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:49.108177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee40e9f-3221-46c4-b3da-a5f49bf7dacc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:49.127865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483da819-0aa7-4acd-a804-a7dccf9d28c4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:49.143914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaae19-1b9d-4bd7-8ac3-38285c001f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:49.145006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaae19-1b9d-4bd7-8ac3-38285c001f02 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:49.145430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaae19-1b9d-4bd7-8ac3-38285c001f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:49.145858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaae19-1b9d-4bd7-8ac3-38285c001f02 None admin] PATH_INFO: `/v3/users/5dacf821834c434a822a5d4f64c8fbf6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:49.147759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaae19-1b9d-4bd7-8ac3-38285c001f02 None admin] RBAC: Authorizing `identity:get_user(user_id=5dacf821834c434a822a5d4f64c8fbf6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:49.149378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaae19-1b9d-4bd7-8ac3-38285c001f02 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:49.151169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 44/84] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/users/5dacf821834c434a822a5d4f64c8fbf6 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:49.156797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaae19-1b9d-4bd7-8ac3-38285c001f02 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:49.169436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd9b44-af15-4d97-8fd4-341d2b505dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:49.170423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd9b44-af15-4d97-8fd4-341d2b505dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:49.170731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd9b44-af15-4d97-8fd4-341d2b505dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:49.171019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd9b44-af15-4d97-8fd4-341d2b505dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:49.172103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd9b44-af15-4d97-8fd4-341d2b505dd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:49.172425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd9b44-af15-4d97-8fd4-341d2b505dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:49.173988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd9b44-af15-4d97-8fd4-341d2b505dd7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:49.185193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 41/85] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:54:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:49.186340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd9b44-af15-4d97-8fd4-341d2b505dd7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:49.250048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:49.252882 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:49.267314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaae19-1b9d-4bd7-8ac3-38285c001f02 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:49.307066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781a8c7-ec56-4f23-bc92-a6815cbf5e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:49.308189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781a8c7-ec56-4f23-bc92-a6815cbf5e7a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:49.308676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781a8c7-ec56-4f23-bc92-a6815cbf5e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:49.309148 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781a8c7-ec56-4f23-bc92-a6815cbf5e7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:49.321210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd9b44-af15-4d97-8fd4-341d2b505dd7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:49.372663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6800c6-fad8-4167-ae97-668911df230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:49.373933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6800c6-fad8-4167-ae97-668911df230f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:49.374487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6800c6-fad8-4167-ae97-668911df230f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:49.374958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6800c6-fad8-4167-ae97-668911df230f None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:49.376643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6800c6-fad8-4167-ae97-668911df230f None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:49.378445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6800c6-fad8-4167-ae97-668911df230f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:49.380868 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 42/86] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:49 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:49.382865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6800c6-fad8-4167-ae97-668911df230f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:49.392242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781a8c7-ec56-4f23-bc92-a6815cbf5e7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:49.393730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781a8c7-ec56-4f23-bc92-a6815cbf5e7a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:49.493424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6800c6-fad8-4167-ae97-668911df230f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:49.500843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:49.515669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:49.522180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 45/87] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:54:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:54:49.522180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781a8c7-ec56-4f23-bc92-a6815cbf5e7a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:49.542233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a874804-764a-493d-a450-490ba91ebdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:49.543608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a874804-764a-493d-a450-490ba91ebdfb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:49.544394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a874804-764a-493d-a450-490ba91ebdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:49.544901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a874804-764a-493d-a450-490ba91ebdfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:49.628296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a874804-764a-493d-a450-490ba91ebdfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:49.629830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a874804-764a-493d-a450-490ba91ebdfb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:49.651749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781a8c7-ec56-4f23-bc92-a6815cbf5e7a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:49.688854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca19ab-3772-413c-8adb-5e6e00524952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:49.689787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca19ab-3772-413c-8adb-5e6e00524952 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:49.690072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca19ab-3772-413c-8adb-5e6e00524952 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:49.690353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca19ab-3772-413c-8adb-5e6e00524952 None admin] PATH_INFO: `/v3/users/f20f5723be9f401d87512332d772d548` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:49.691629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca19ab-3772-413c-8adb-5e6e00524952 None admin] RBAC: Authorizing `identity:get_user(user_id=f20f5723be9f401d87512332d772d548)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:49.693164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca19ab-3772-413c-8adb-5e6e00524952 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:49.695477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 46/88] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:49 2022] GET /identity/v3/users/f20f5723be9f401d87512332d772d548 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:49.700651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca19ab-3772-413c-8adb-5e6e00524952 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:49.767931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 43/89] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:54:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:54:49.768858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a874804-764a-493d-a450-490ba91ebdfb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:49.777331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:49.791998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:49.820168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca19ab-3772-413c-8adb-5e6e00524952 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:49.857521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f09aad-c14a-4a01-8efb-31f3d055dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:49.858692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f09aad-c14a-4a01-8efb-31f3d055dbbc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:49.859207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f09aad-c14a-4a01-8efb-31f3d055dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:49.859736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f09aad-c14a-4a01-8efb-31f3d055dbbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:49.861524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f09aad-c14a-4a01-8efb-31f3d055dbbc None admin] RBAC: Adding query filter params (role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a, user.id=f20f5723be9f401d87512332d772d548) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:49.862077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f09aad-c14a-4a01-8efb-31f3d055dbbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:49.864680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f09aad-c14a-4a01-8efb-31f3d055dbbc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:49.875604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 47/90] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:54:49 2022] GET /identity/v3/role_assignments?user.id=f20f5723be9f401d87512332d772d548&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:49.876732 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f09aad-c14a-4a01-8efb-31f3d055dbbc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:49.921468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a874804-764a-493d-a450-490ba91ebdfb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:50.001487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faeda0-f59a-433c-90a9-53adfd0e8b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:50.002806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faeda0-f59a-433c-90a9-53adfd0e8b64 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:50.003319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faeda0-f59a-433c-90a9-53adfd0e8b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:50.003845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faeda0-f59a-433c-90a9-53adfd0e8b64 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:50.007207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faeda0-f59a-433c-90a9-53adfd0e8b64 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:50.009961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faeda0-f59a-433c-90a9-53adfd0e8b64 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:50.015360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 44/91] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:49 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:50.016517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faeda0-f59a-433c-90a9-53adfd0e8b64 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:50.092173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f09aad-c14a-4a01-8efb-31f3d055dbbc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:50.123903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:50.172559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:50.180052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf07c1-c8a6-419b-b85f-05daab5dacdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:50.180786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf07c1-c8a6-419b-b85f-05daab5dacdd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:50.181082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf07c1-c8a6-419b-b85f-05daab5dacdd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:50.181368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf07c1-c8a6-419b-b85f-05daab5dacdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:50.190782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faeda0-f59a-433c-90a9-53adfd0e8b64 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:50.236629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483cc39-e413-48fb-acaf-a4dfd2eb4373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:50.237510 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483cc39-e413-48fb-acaf-a4dfd2eb4373 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:50.237799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483cc39-e413-48fb-acaf-a4dfd2eb4373 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:50.238080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483cc39-e413-48fb-acaf-a4dfd2eb4373 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:50.241467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483cc39-e413-48fb-acaf-a4dfd2eb4373 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:50.242964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483cc39-e413-48fb-acaf-a4dfd2eb4373 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:50.251417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 45/92] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:50 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:50.252320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483cc39-e413-48fb-acaf-a4dfd2eb4373 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:50.295196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf07c1-c8a6-419b-b85f-05daab5dacdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:50.296744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf07c1-c8a6-419b-b85f-05daab5dacdd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:50.408732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483cc39-e413-48fb-acaf-a4dfd2eb4373 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:50.467072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594b0c4-1aea-48db-9809-01873f5921f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:50.468532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594b0c4-1aea-48db-9809-01873f5921f5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:50.469300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594b0c4-1aea-48db-9809-01873f5921f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:50.470620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594b0c4-1aea-48db-9809-01873f5921f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:50.472882 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594b0c4-1aea-48db-9809-01873f5921f5 None admin] RBAC: Adding query filter params (role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a, user.id=f20f5723be9f401d87512332d772d548) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:50.473215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594b0c4-1aea-48db-9809-01873f5921f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:50.474739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594b0c4-1aea-48db-9809-01873f5921f5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:50.483920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 46/93] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:54:50 2022] GET /identity/v3/role_assignments?user.id=f20f5723be9f401d87512332d772d548&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=478978f29ae748188de8d1a31490bb00 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:50.488762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 48/94] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:54:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:54:50.489253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594b0c4-1aea-48db-9809-01873f5921f5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:50.495230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf07c1-c8a6-419b-b85f-05daab5dacdd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:50.535993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:50.536505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:50.635611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594b0c4-1aea-48db-9809-01873f5921f5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:50.678763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bf5b6-3c7b-42d3-b2c1-3f368212d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:50.679896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bf5b6-3c7b-42d3-b2c1-3f368212d75f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:50.680416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bf5b6-3c7b-42d3-b2c1-3f368212d75f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:50.680900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bf5b6-3c7b-42d3-b2c1-3f368212d75f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:50.681970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bf5b6-3c7b-42d3-b2c1-3f368212d75f None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a, user.id=5dacf821834c434a822a5d4f64c8fbf6) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:50.682739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bf5b6-3c7b-42d3-b2c1-3f368212d75f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:50.685416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bf5b6-3c7b-42d3-b2c1-3f368212d75f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:50.697128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 47/95] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:54:50 2022] GET /identity/v3/role_assignments?user.id=5dacf821834c434a822a5d4f64c8fbf6&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:50.700302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf07c1-c8a6-419b-b85f-05daab5dacdd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:50.715859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b2490-43a1-4133-9a90-6bfa431bd937 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:50.716542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b2490-43a1-4133-9a90-6bfa431bd937 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:50.717111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b2490-43a1-4133-9a90-6bfa431bd937 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:50.718752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 48/96] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:50.727483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809cfb2-dc13-40ef-83fa-849c567d02c4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:50.727786 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809cfb2-dc13-40ef-83fa-849c567d02c4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:50.728196 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809cfb2-dc13-40ef-83fa-849c567d02c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:50.761288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5809cfb2-dc13-40ef-83fa-849c567d02c4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:50.762537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5809cfb2-dc13-40ef-83fa-849c567d02c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:50.791329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f55e-3f77-4258-90a6-a1a0b1028c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:50.792237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f55e-3f77-4258-90a6-a1a0b1028c69 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:50.792524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f55e-3f77-4258-90a6-a1a0b1028c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:50.792799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f55e-3f77-4258-90a6-a1a0b1028c69 None admin] PATH_INFO: `/v3/projects/e6428f12b1e54a76b5df0d7d282ee98c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:50.796818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f55e-3f77-4258-90a6-a1a0b1028c69 None admin] RBAC: Authorizing `identity:get_project(project_id=e6428f12b1e54a76b5df0d7d282ee98c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:50.798412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f55e-3f77-4258-90a6-a1a0b1028c69 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:50.800462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 49/97] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:50 2022] GET /identity/v3/projects/e6428f12b1e54a76b5df0d7d282ee98c => generated 312 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:50.806903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f55e-3f77-4258-90a6-a1a0b1028c69 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:50.853617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 49/98] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:50.902280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809cfb2-dc13-40ef-83fa-849c567d02c4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:50.922420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:50.992335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:51.008942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f55e-3f77-4258-90a6-a1a0b1028c69 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:51.035917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809cfb2-dc13-40ef-83fa-849c567d02c4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:51.068618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87e40e-b6ed-40fd-806b-f29ea3f3d61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:51.069280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e40e-b6ed-40fd-806b-f29ea3f3d61a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:51.069565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e40e-b6ed-40fd-806b-f29ea3f3d61a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:51.069845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87e40e-b6ed-40fd-806b-f29ea3f3d61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:51.070687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87e40e-b6ed-40fd-806b-f29ea3f3d61a None admin] RBAC: Adding query filter params (role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=e6428f12b1e54a76b5df0d7d282ee98c, user.id=f20f5723be9f401d87512332d772d548) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:51.071001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87e40e-b6ed-40fd-806b-f29ea3f3d61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:51.072476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87e40e-b6ed-40fd-806b-f29ea3f3d61a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:51.083725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 50/99] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:54:50 2022] GET /identity/v3/role_assignments?user.id=f20f5723be9f401d87512332d772d548&scope.project.id=e6428f12b1e54a76b5df0d7d282ee98c&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:51.085478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41584637-ff4c-4b01-af36-b4145394c7a4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:51.085675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41584637-ff4c-4b01-af36-b4145394c7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:51.085955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41584637-ff4c-4b01-af36-b4145394c7a4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:51.087263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 51/100] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:51.093745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f185bd-913c-4924-a1a1-fcc0a5b6d4e4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:51.094045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f185bd-913c-4924-a1a1-fcc0a5b6d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:51.094305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f185bd-913c-4924-a1a1-fcc0a5b6d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:51.097122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5df8b-a02a-4bae-8b1c-83517a59b805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:51.097942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5df8b-a02a-4bae-8b1c-83517a59b805 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:51.098225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5df8b-a02a-4bae-8b1c-83517a59b805 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:51.098499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5df8b-a02a-4bae-8b1c-83517a59b805 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:51.100818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5df8b-a02a-4bae-8b1c-83517a59b805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:51.102276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5df8b-a02a-4bae-8b1c-83517a59b805 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:51.104210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 50/101] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:51.113244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5df8b-a02a-4bae-8b1c-83517a59b805 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:51.134349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-78f185bd-913c-4924-a1a1-fcc0a5b6d4e4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:51.135539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-78f185bd-913c-4924-a1a1-fcc0a5b6d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:51.276962 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:51.281785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 52/102] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:51.301966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5df8b-a02a-4bae-8b1c-83517a59b805 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:51.322456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f185bd-913c-4924-a1a1-fcc0a5b6d4e4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:51.357652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a950ba-1d23-40a5-86e9-947a1707aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:51.358690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a950ba-1d23-40a5-86e9-947a1707aaec None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:51.358990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a950ba-1d23-40a5-86e9-947a1707aaec None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:51.359409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a950ba-1d23-40a5-86e9-947a1707aaec None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:51.360183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a950ba-1d23-40a5-86e9-947a1707aaec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:51.361669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a950ba-1d23-40a5-86e9-947a1707aaec None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:51.454343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:51.478039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 51/103] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:54:51 2022] POST /identity/v3/projects => generated 302 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:54:51.489476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f185bd-913c-4924-a1a1-fcc0a5b6d4e4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:51.571468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e842e1-1c01-4c92-9777-eaf5e524493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:51.572228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e842e1-1c01-4c92-9777-eaf5e524493c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:51.572512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e842e1-1c01-4c92-9777-eaf5e524493c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:51.572787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e842e1-1c01-4c92-9777-eaf5e524493c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:51.589770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e842e1-1c01-4c92-9777-eaf5e524493c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-40e842e1-1c01-4c92-9777-eaf5e524493c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:51.597770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:51.598751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:51.599518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 53/104] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:54:51.606281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a950ba-1d23-40a5-86e9-947a1707aaec None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:51.733255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a950ba-1d23-40a5-86e9-947a1707aaec None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:51.775825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:51.782168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fc5d8-923d-4fa9-a7c6-5fe787019094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:51.782889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fc5d8-923d-4fa9-a7c6-5fe787019094 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:51.783173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fc5d8-923d-4fa9-a7c6-5fe787019094 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:51.783450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fc5d8-923d-4fa9-a7c6-5fe787019094 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:51.784233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fc5d8-923d-4fa9-a7c6-5fe787019094 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:51.790464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fc5d8-923d-4fa9-a7c6-5fe787019094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:51.790464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fc5d8-923d-4fa9-a7c6-5fe787019094 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:51.799965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 52/105] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:54:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:51.805814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e842e1-1c01-4c92-9777-eaf5e524493c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:51.918610 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e842e1-1c01-4c92-9777-eaf5e524493c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:51.965883 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c183af-3640-485e-841b-923364101c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:51.967172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c183af-3640-485e-841b-923364101c3a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:51.967729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c183af-3640-485e-841b-923364101c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:51.968247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c183af-3640-485e-841b-923364101c3a None admin] PATH_INFO: `/v3/users/591f19d8f9474871954e94e1564b1556` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:51.984932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:51.994274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c183af-3640-485e-841b-923364101c3a None admin] RBAC: Authorizing `identity:get_user(user_id=591f19d8f9474871954e94e1564b1556)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:51.996075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c183af-3640-485e-841b-923364101c3a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:51.997990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 54/106] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:51 2022] GET /identity/v3/users/591f19d8f9474871954e94e1564b1556 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:52.003454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fc5d8-923d-4fa9-a7c6-5fe787019094 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:52.143040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fc5d8-923d-4fa9-a7c6-5fe787019094 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:52.182571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f6398-89ff-4203-be04-38cada7751df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:52.183143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6398-89ff-4203-be04-38cada7751df None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:52.183427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6398-89ff-4203-be04-38cada7751df None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:52.183707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6398-89ff-4203-be04-38cada7751df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:52.261079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:52.271262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f6398-89ff-4203-be04-38cada7751df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:52.272846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f6398-89ff-4203-be04-38cada7751df None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:52.401259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 53/107] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:54:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:54:52.406990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c183af-3640-485e-841b-923364101c3a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:52.547645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c183af-3640-485e-841b-923364101c3a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:52.581166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5944-3e98-475e-b5f4-0c54d25cfdf0 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:52.581813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5944-3e98-475e-b5f4-0c54d25cfdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:52.582292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5944-3e98-475e-b5f4-0c54d25cfdf0 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:52.583998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 54/108] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:54:52.593095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799764e-8c62-4c9c-a4d4-0ed55d7afbca None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:52.593714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799764e-8c62-4c9c-a4d4-0ed55d7afbca None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:52.594189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799764e-8c62-4c9c-a4d4-0ed55d7afbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:52.622534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7799764e-8c62-4c9c-a4d4-0ed55d7afbca None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:52.625137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7799764e-8c62-4c9c-a4d4-0ed55d7afbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:52.631249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78fb69-38a9-42e2-b8bc-742b2b2e2c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:52.632133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78fb69-38a9-42e2-b8bc-742b2b2e2c6e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:52.632424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78fb69-38a9-42e2-b8bc-742b2b2e2c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:52.632701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78fb69-38a9-42e2-b8bc-742b2b2e2c6e None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:52.634557 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78fb69-38a9-42e2-b8bc-742b2b2e2c6e None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:52.644345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78fb69-38a9-42e2-b8bc-742b2b2e2c6e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:52.646059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 55/109] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:52 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:52.653061 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78fb69-38a9-42e2-b8bc-742b2b2e2c6e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:52.774776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 55/110] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:54:52.805095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799764e-8c62-4c9c-a4d4-0ed55d7afbca None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:52.812268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:52.848012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:52.885563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78fb69-38a9-42e2-b8bc-742b2b2e2c6e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:52.957682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb6f1-e2e2-4248-9ed9-ba044b4dd80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:52.958372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb6f1-e2e2-4248-9ed9-ba044b4dd80d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:52.958661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb6f1-e2e2-4248-9ed9-ba044b4dd80d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:52.958944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb6f1-e2e2-4248-9ed9-ba044b4dd80d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:52.960104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb6f1-e2e2-4248-9ed9-ba044b4dd80d None admin] RBAC: Adding query filter params (role.id=57d52c1b0a1443818028148b95eb44f6, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a, user.id=591f19d8f9474871954e94e1564b1556) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:52.960466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb6f1-e2e2-4248-9ed9-ba044b4dd80d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:52.962037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb6f1-e2e2-4248-9ed9-ba044b4dd80d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:52.976378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 56/111] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:54:52 2022] GET /identity/v3/role_assignments?user.id=591f19d8f9474871954e94e1564b1556&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=57d52c1b0a1443818028148b95eb44f6 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:52.978456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799764e-8c62-4c9c-a4d4-0ed55d7afbca None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:53.055026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce2abe-2215-441e-a237-50cf2c1c7565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:53.056188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce2abe-2215-441e-a237-50cf2c1c7565 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:53.056681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce2abe-2215-441e-a237-50cf2c1c7565 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:53.057162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce2abe-2215-441e-a237-50cf2c1c7565 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:53.077670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce2abe-2215-441e-a237-50cf2c1c7565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b7ce2abe-2215-441e-a237-50cf2c1c7565 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:53.091902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:53.092804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:53.093553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:54:53.096191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 56/112] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:54:53.109066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb6f1-e2e2-4248-9ed9-ba044b4dd80d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:53.247331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb6f1-e2e2-4248-9ed9-ba044b4dd80d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:53.278294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:53.291295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205486f3-0f3c-4a0d-9b6a-124bcd8c3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:53.292018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205486f3-0f3c-4a0d-9b6a-124bcd8c3379 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:53.292310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205486f3-0f3c-4a0d-9b6a-124bcd8c3379 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:53.292596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205486f3-0f3c-4a0d-9b6a-124bcd8c3379 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:53.296471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205486f3-0f3c-4a0d-9b6a-124bcd8c3379 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:53.296471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205486f3-0f3c-4a0d-9b6a-124bcd8c3379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:53.296471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205486f3-0f3c-4a0d-9b6a-124bcd8c3379 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:53.305367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 57/113] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:54:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:53.310992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce2abe-2215-441e-a237-50cf2c1c7565 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:53.438894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:53.458523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce2abe-2215-441e-a237-50cf2c1c7565 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:53.505245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511457ff-ef8a-41f8-ac13-259db7429ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:53.505245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511457ff-ef8a-41f8-ac13-259db7429ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:53.505245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511457ff-ef8a-41f8-ac13-259db7429ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:53.505574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511457ff-ef8a-41f8-ac13-259db7429ca5 None admin] PATH_INFO: `/v3/users/f20f5723be9f401d87512332d772d548` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:53.507964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511457ff-ef8a-41f8-ac13-259db7429ca5 None admin] RBAC: Authorizing `identity:get_user(user_id=f20f5723be9f401d87512332d772d548)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:53.511893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511457ff-ef8a-41f8-ac13-259db7429ca5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:53.511893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 57/114] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:53 2022] GET /identity/v3/users/f20f5723be9f401d87512332d772d548 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:53.517007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205486f3-0f3c-4a0d-9b6a-124bcd8c3379 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:53.641959 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f60a-98c2-45d4-8b96-5d05c7787c2e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:53.642483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f60a-98c2-45d4-8b96-5d05c7787c2e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:53.642567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320f60a-98c2-45d4-8b96-5d05c7787c2e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:53.643916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 58/115] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:53.644999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787e30d-4d39-4e76-aa34-e56dfa57ffe3 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:53.645293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787e30d-4d39-4e76-aa34-e56dfa57ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:53.645575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787e30d-4d39-4e76-aa34-e56dfa57ffe3 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:53.647741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 59/116] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:53.653292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c553cf-966c-488f-b089-4118fbdce919 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:53.653592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c553cf-966c-488f-b089-4118fbdce919 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:53.653876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c553cf-966c-488f-b089-4118fbdce919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:53.683716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-63c553cf-966c-488f-b089-4118fbdce919 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:53.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-63c553cf-966c-488f-b089-4118fbdce919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:53.708049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205486f3-0f3c-4a0d-9b6a-124bcd8c3379 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:53.750681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0938f67-4e62-4386-a9cd-3c767d5c1a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:53.751562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0938f67-4e62-4386-a9cd-3c767d5c1a5d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:53.751847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0938f67-4e62-4386-a9cd-3c767d5c1a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:53.752303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0938f67-4e62-4386-a9cd-3c767d5c1a5d None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:53.754097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0938f67-4e62-4386-a9cd-3c767d5c1a5d None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:53.755557 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0938f67-4e62-4386-a9cd-3c767d5c1a5d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:53.764676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 58/117] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:53 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:53.766618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79185792-462c-4a2b-83b5-913052a3c17a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:53.766912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79185792-462c-4a2b-83b5-913052a3c17a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:53.767200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79185792-462c-4a2b-83b5-913052a3c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:53.801675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-79185792-462c-4a2b-83b5-913052a3c17a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:53.805261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-79185792-462c-4a2b-83b5-913052a3c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:53.836980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 60/118] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:53.837720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c553cf-966c-488f-b089-4118fbdce919 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:53.922698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:53.944472 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:53.958141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 59/119] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:53.958830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79185792-462c-4a2b-83b5-913052a3c17a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:53.991679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c553cf-966c-488f-b089-4118fbdce919 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:54.031326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14605a-2225-4808-be23-a361f1c235ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:54.032588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14605a-2225-4808-be23-a361f1c235ed None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.033075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14605a-2225-4808-be23-a361f1c235ed None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.033559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14605a-2225-4808-be23-a361f1c235ed None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/users/f20f5723be9f401d87512332d772d548/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.035732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14605a-2225-4808-be23-a361f1c235ed None admin] RBAC: Authorizing `identity:create_grant(project_id=9664179425e34ff98312ac1c4cdc1f0a, user_id=f20f5723be9f401d87512332d772d548, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:54.038442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14605a-2225-4808-be23-a361f1c235ed None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:54.125605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79185792-462c-4a2b-83b5-913052a3c17a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:54.155807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 61/120] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:54:53 2022] PUT /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/users/f20f5723be9f401d87512332d772d548/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:54:54.157078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14605a-2225-4808-be23-a361f1c235ed None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:54.171656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495739c-b863-48c1-86b3-416b9c245661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:54.172505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495739c-b863-48c1-86b3-416b9c245661 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.172869 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495739c-b863-48c1-86b3-416b9c245661 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.173076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495739c-b863-48c1-86b3-416b9c245661 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.192037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495739c-b863-48c1-86b3-416b9c245661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1495739c-b863-48c1-86b3-416b9c245661 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:54.208622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:54.210107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:54.210877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 60/121] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:54:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:54.219052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495739c-b863-48c1-86b3-416b9c245661 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:54.306508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:54.355101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14605a-2225-4808-be23-a361f1c235ed None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:54.407317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495739c-b863-48c1-86b3-416b9c245661 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:54.437740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a601794-8730-4249-9fe8-f4ef327ec535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:54.438803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a601794-8730-4249-9fe8-f4ef327ec535 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.439261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a601794-8730-4249-9fe8-f4ef327ec535 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.439678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a601794-8730-4249-9fe8-f4ef327ec535 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.455734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228a31c-a8cd-446c-a69b-cf7a30d1d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:54.456673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228a31c-a8cd-446c-a69b-cf7a30d1d2eb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.461219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228a31c-a8cd-446c-a69b-cf7a30d1d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.461219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228a31c-a8cd-446c-a69b-cf7a30d1d2eb None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.461404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:54.461489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228a31c-a8cd-446c-a69b-cf7a30d1d2eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:54.461489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228a31c-a8cd-446c-a69b-cf7a30d1d2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:54.461489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228a31c-a8cd-446c-a69b-cf7a30d1d2eb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:54.462929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a601794-8730-4249-9fe8-f4ef327ec535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:54.469414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 61/122] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:54:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0a601794-8730-4249-9fe8-f4ef327ec535 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:54.470733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:54.471568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:54:54.472575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:54:54.473234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 62/123] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:54:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:54.473969 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483f6d-f9b9-4868-87a7-19349b18c942 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.474384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483f6d-f9b9-4868-87a7-19349b18c942 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.475320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483f6d-f9b9-4868-87a7-19349b18c942 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.476843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 62/124] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:54.479980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a601794-8730-4249-9fe8-f4ef327ec535 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:54.483362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c483f6d-f9b9-4868-87a7-19349b18c942 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:54.612762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a601794-8730-4249-9fe8-f4ef327ec535 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:54.623692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c483f6d-f9b9-4868-87a7-19349b18c942 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:54.650327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605148a-a345-44b5-86e2-7d259c751bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:54.651179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605148a-a345-44b5-86e2-7d259c751bdd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.651472 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605148a-a345-44b5-86e2-7d259c751bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.651755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605148a-a345-44b5-86e2-7d259c751bdd None admin] PATH_INFO: `/v3/users/f20f5723be9f401d87512332d772d548` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.653056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605148a-a345-44b5-86e2-7d259c751bdd None admin] RBAC: Authorizing `identity:get_user(user_id=f20f5723be9f401d87512332d772d548)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:54.654535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605148a-a345-44b5-86e2-7d259c751bdd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:54.656652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 63/125] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:54 2022] GET /identity/v3/users/f20f5723be9f401d87512332d772d548 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:54.657830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddf460-12cf-4169-b37e-b368731f6d25 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.658123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddf460-12cf-4169-b37e-b368731f6d25 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.658420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddf460-12cf-4169-b37e-b368731f6d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.660253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:54.675895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f455-72a6-4c10-8b61-6b7b0e37704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:54.675895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f455-72a6-4c10-8b61-6b7b0e37704d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.675895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f455-72a6-4c10-8b61-6b7b0e37704d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.675895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f455-72a6-4c10-8b61-6b7b0e37704d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.679485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f455-72a6-4c10-8b61-6b7b0e37704d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:54.679485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f455-72a6-4c10-8b61-6b7b0e37704d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:54.679485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f455-72a6-4c10-8b61-6b7b0e37704d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:54.694247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2dddf460-12cf-4169-b37e-b368731f6d25 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:54.697012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2dddf460-12cf-4169-b37e-b368731f6d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:54.701180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 63/126] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:54.702098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f455-72a6-4c10-8b61-6b7b0e37704d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:54.795271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:54.807897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 64/127] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:54.807897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddf460-12cf-4169-b37e-b368731f6d25 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:54.863039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f455-72a6-4c10-8b61-6b7b0e37704d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:54.915804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18869818-0061-4ae8-b990-371a9ae69904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:54.916274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddf460-12cf-4169-b37e-b368731f6d25 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:54.917138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18869818-0061-4ae8-b990-371a9ae69904 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.917833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18869818-0061-4ae8-b990-371a9ae69904 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.918272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18869818-0061-4ae8-b990-371a9ae69904 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.920594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18869818-0061-4ae8-b990-371a9ae69904 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:54.922226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18869818-0061-4ae8-b990-371a9ae69904 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:54.929166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 64/128] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:54 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:54.931139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918bee-7d1a-4fab-80d4-eb090f340d15 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.931855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918bee-7d1a-4fab-80d4-eb090f340d15 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.932324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918bee-7d1a-4fab-80d4-eb090f340d15 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.936478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 65/129] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:54.937441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918bee-7d1a-4fab-80d4-eb090f340d15 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:54.964488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c652d52-1dad-405d-84be-2a0a7feda007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:54.965363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c652d52-1dad-405d-84be-2a0a7feda007 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:54.965654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c652d52-1dad-405d-84be-2a0a7feda007 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:54.965937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c652d52-1dad-405d-84be-2a0a7feda007 None admin] PATH_INFO: `/v3/users/5dacf821834c434a822a5d4f64c8fbf6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:54.967217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c652d52-1dad-405d-84be-2a0a7feda007 None admin] RBAC: Authorizing `identity:get_user(user_id=5dacf821834c434a822a5d4f64c8fbf6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:54.969087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c652d52-1dad-405d-84be-2a0a7feda007 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:54.975904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 65/130] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:54 2022] GET /identity/v3/users/5dacf821834c434a822a5d4f64c8fbf6 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:54.975904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c652d52-1dad-405d-84be-2a0a7feda007 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:54.995685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:55.062212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:55.064638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918bee-7d1a-4fab-80d4-eb090f340d15 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:55.103240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ae2f3-19b2-48ac-8b2c-ccce6ee5eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:55.104350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ae2f3-19b2-48ac-8b2c-ccce6ee5eca8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:55.104707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ae2f3-19b2-48ac-8b2c-ccce6ee5eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:55.104927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ae2f3-19b2-48ac-8b2c-ccce6ee5eca8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:55.109372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c652d52-1dad-405d-84be-2a0a7feda007 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:55.120276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ae2f3-19b2-48ac-8b2c-ccce6ee5eca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-540ae2f3-19b2-48ac-8b2c-ccce6ee5eca8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:55.128395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:55.129287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:55.130513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 66/131] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:55.137242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2f238-af1a-480d-948f-f470e8f02698 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:55.137242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2f238-af1a-480d-948f-f470e8f02698 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:55.137550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2f238-af1a-480d-948f-f470e8f02698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:55.154853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b464df-83cf-46f8-bbd8-102243c1f0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:55.156220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b464df-83cf-46f8-bbd8-102243c1f0a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:55.156725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b464df-83cf-46f8-bbd8-102243c1f0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:55.157110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c5d2f238-af1a-480d-948f-f470e8f02698 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:55.157433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b464df-83cf-46f8-bbd8-102243c1f0a1 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/users/f20f5723be9f401d87512332d772d548/roles/478978f29ae748188de8d1a31490bb00` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:55.158503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c5d2f238-af1a-480d-948f-f470e8f02698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:55.160227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b464df-83cf-46f8-bbd8-102243c1f0a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9664179425e34ff98312ac1c4cdc1f0a, user_id=f20f5723be9f401d87512332d772d548, role_id=478978f29ae748188de8d1a31490bb00)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:55.163332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b464df-83cf-46f8-bbd8-102243c1f0a1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:55.239984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 67/132] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:55.239984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2f238-af1a-480d-948f-f470e8f02698 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:55.269087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 66/133] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:54:54 2022] PUT /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/users/f20f5723be9f401d87512332d772d548/roles/478978f29ae748188de8d1a31490bb00 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:54:55.277079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b464df-83cf-46f8-bbd8-102243c1f0a1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:55.289994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:55.405523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b464df-83cf-46f8-bbd8-102243c1f0a1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:55.440265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:55.452596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625adbf-a6bd-4dc6-a9aa-4732fb5e515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:55.453670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625adbf-a6bd-4dc6-a9aa-4732fb5e515d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:55.454164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625adbf-a6bd-4dc6-a9aa-4732fb5e515d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:55.454671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625adbf-a6bd-4dc6-a9aa-4732fb5e515d None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:55.456349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625adbf-a6bd-4dc6-a9aa-4732fb5e515d None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:55.463487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625adbf-a6bd-4dc6-a9aa-4732fb5e515d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:55.463487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625adbf-a6bd-4dc6-a9aa-4732fb5e515d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:55.463685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2f238-af1a-480d-948f-f470e8f02698 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:55.469678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 67/134] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:54:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:55.471009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625adbf-a6bd-4dc6-a9aa-4732fb5e515d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:55.562646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334de5f-bde6-449d-a392-917d424b6bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:55.563533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334de5f-bde6-449d-a392-917d424b6bec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:55.563813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334de5f-bde6-449d-a392-917d424b6bec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:55.564124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334de5f-bde6-449d-a392-917d424b6bec None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:55.565330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334de5f-bde6-449d-a392-917d424b6bec None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:55.566808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334de5f-bde6-449d-a392-917d424b6bec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:55.569433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 68/135] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:55 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:55.570050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334de5f-bde6-449d-a392-917d424b6bec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:55.606195 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625adbf-a6bd-4dc6-a9aa-4732fb5e515d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:55.672774 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eea80-a9dc-499b-9c5f-17dd07cc0568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:55.679170 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eea80-a9dc-499b-9c5f-17dd07cc0568 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:55.679740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eea80-a9dc-499b-9c5f-17dd07cc0568 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:55.680300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eea80-a9dc-499b-9c5f-17dd07cc0568 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:55.682103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eea80-a9dc-499b-9c5f-17dd07cc0568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:55.685516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eea80-a9dc-499b-9c5f-17dd07cc0568 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:55.687630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 68/136] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:54:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:55.689930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eea80-a9dc-499b-9c5f-17dd07cc0568 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:55.724133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:55.730176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334de5f-bde6-449d-a392-917d424b6bec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:55.798682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056edb00-50de-4187-b03f-4bd82cc04915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:55.799706 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056edb00-50de-4187-b03f-4bd82cc04915 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:55.801020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056edb00-50de-4187-b03f-4bd82cc04915 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:55.801314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056edb00-50de-4187-b03f-4bd82cc04915 None admin] PATH_INFO: `/v3/users/f20f5723be9f401d87512332d772d548` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:55.802744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056edb00-50de-4187-b03f-4bd82cc04915 None admin] RBAC: Authorizing `identity:get_user(user_id=f20f5723be9f401d87512332d772d548)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:55.804635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056edb00-50de-4187-b03f-4bd82cc04915 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:55.807454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:55.808157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 69/137] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:55 2022] GET /identity/v3/users/f20f5723be9f401d87512332d772d548 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:55.811653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056edb00-50de-4187-b03f-4bd82cc04915 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:55.867382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eea80-a9dc-499b-9c5f-17dd07cc0568 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:55.903709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f076f8-602c-4ebb-8a88-b851a7238084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:55.905018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f076f8-602c-4ebb-8a88-b851a7238084 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:55.905499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f076f8-602c-4ebb-8a88-b851a7238084 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:55.906129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f076f8-602c-4ebb-8a88-b851a7238084 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/users/5dacf821834c434a822a5d4f64c8fbf6/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:55.908481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f076f8-602c-4ebb-8a88-b851a7238084 None admin] RBAC: Authorizing `identity:create_grant(project_id=9664179425e34ff98312ac1c4cdc1f0a, user_id=5dacf821834c434a822a5d4f64c8fbf6, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:55.910335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f076f8-602c-4ebb-8a88-b851a7238084 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:55.922796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056edb00-50de-4187-b03f-4bd82cc04915 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:55.960110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053fb48-56ea-4a33-bf6c-360b5dd58d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:55.961180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053fb48-56ea-4a33-bf6c-360b5dd58d77 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:55.961479 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053fb48-56ea-4a33-bf6c-360b5dd58d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:55.961764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053fb48-56ea-4a33-bf6c-360b5dd58d77 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:55.962502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053fb48-56ea-4a33-bf6c-360b5dd58d77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:55.964075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053fb48-56ea-4a33-bf6c-360b5dd58d77 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:55.989083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 69/138] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:54:55 2022] PUT /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/users/5dacf821834c434a822a5d4f64c8fbf6/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:54:55.992464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f076f8-602c-4ebb-8a88-b851a7238084 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:56.081151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 70/139] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:54:55 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:54:56.082561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337029-ba3d-489e-b40a-4672f3078c5f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:56.082911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337029-ba3d-489e-b40a-4672f3078c5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:56.084353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337029-ba3d-489e-b40a-4672f3078c5f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:56.092715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 71/140] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:56.098411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93f0f7-6cc1-4eee-876a-17c5aa6c4852 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:56.098715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93f0f7-6cc1-4eee-876a-17c5aa6c4852 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:56.098985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93f0f7-6cc1-4eee-876a-17c5aa6c4852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:56.121972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f076f8-602c-4ebb-8a88-b851a7238084 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:56.141275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4e93f0f7-6cc1-4eee-876a-17c5aa6c4852 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:56.142528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4e93f0f7-6cc1-4eee-876a-17c5aa6c4852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:56.143339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:56.172543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db81d7-b3dd-4a9d-a113-1cc81e479d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:56.174236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db81d7-b3dd-4a9d-a113-1cc81e479d60 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:56.174762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db81d7-b3dd-4a9d-a113-1cc81e479d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:56.175282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db81d7-b3dd-4a9d-a113-1cc81e479d60 None admin] PATH_INFO: `/v3/projects/e6428f12b1e54a76b5df0d7d282ee98c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:56.177693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db81d7-b3dd-4a9d-a113-1cc81e479d60 None admin] RBAC: Authorizing `identity:get_project(project_id=e6428f12b1e54a76b5df0d7d282ee98c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:56.179497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db81d7-b3dd-4a9d-a113-1cc81e479d60 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:56.182258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 70/141] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:55 2022] GET /identity/v3/projects/e6428f12b1e54a76b5df0d7d282ee98c => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:56.188134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:56.193089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db81d7-b3dd-4a9d-a113-1cc81e479d60 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:56.289441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 72/142] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:54:56.320193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93f0f7-6cc1-4eee-876a-17c5aa6c4852 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:56.397737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db81d7-b3dd-4a9d-a113-1cc81e479d60 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:56.478438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93f0f7-6cc1-4eee-876a-17c5aa6c4852 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:56.484622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348f19-ab38-4a80-98d0-c4a7cb953117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:56.485546 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348f19-ab38-4a80-98d0-c4a7cb953117 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:56.485831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348f19-ab38-4a80-98d0-c4a7cb953117 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:56.486113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348f19-ab38-4a80-98d0-c4a7cb953117 None admin] PATH_INFO: `/v3/projects/e6428f12b1e54a76b5df0d7d282ee98c/users/f20f5723be9f401d87512332d772d548/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:56.488308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09348f19-ab38-4a80-98d0-c4a7cb953117 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6428f12b1e54a76b5df0d7d282ee98c, user_id=f20f5723be9f401d87512332d772d548, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:56.493565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09348f19-ab38-4a80-98d0-c4a7cb953117 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:56.528247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd3bf4-0d1b-4915-a744-f4ee7aa67f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:56.528247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3bf4-0d1b-4915-a744-f4ee7aa67f1d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:56.528247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3bf4-0d1b-4915-a744-f4ee7aa67f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:56.528247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3bf4-0d1b-4915-a744-f4ee7aa67f1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:56.540580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd3bf4-0d1b-4915-a744-f4ee7aa67f1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-12cd3bf4-0d1b-4915-a744-f4ee7aa67f1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:56.548921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:56.549778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:56.550523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 73/143] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:54:56.558177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd3bf4-0d1b-4915-a744-f4ee7aa67f1d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:56.577739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:56.590158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 71/144] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:54:56 2022] PUT /identity/v3/projects/e6428f12b1e54a76b5df0d7d282ee98c/users/f20f5723be9f401d87512332d772d548/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:54:56.695401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd3bf4-0d1b-4915-a744-f4ee7aa67f1d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:56.733946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096208d4-cea6-4d04-ab79-0f56d8315c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:56.734631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096208d4-cea6-4d04-ab79-0f56d8315c46 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:56.734967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096208d4-cea6-4d04-ab79-0f56d8315c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:56.735257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096208d4-cea6-4d04-ab79-0f56d8315c46 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:56.736045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096208d4-cea6-4d04-ab79-0f56d8315c46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:56.736406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096208d4-cea6-4d04-ab79-0f56d8315c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:56.737804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096208d4-cea6-4d04-ab79-0f56d8315c46 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:56.747674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 74/145] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:54:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:56.753220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348f19-ab38-4a80-98d0-c4a7cb953117 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:56.805914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c21ad-e511-4611-8225-3f939e117f95 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:56.806510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c21ad-e511-4611-8225-3f939e117f95 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:56.806977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c21ad-e511-4611-8225-3f939e117f95 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:56.808638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 75/146] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:56.810307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:56.814725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20ce5b-5bb0-4244-8bb0-61f7e84eb237 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:56.815239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20ce5b-5bb0-4244-8bb0-61f7e84eb237 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:56.815683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20ce5b-5bb0-4244-8bb0-61f7e84eb237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:56.846304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8e20ce5b-5bb0-4244-8bb0-61f7e84eb237 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:56.848112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e20ce5b-5bb0-4244-8bb0-61f7e84eb237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:56.938912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348f19-ab38-4a80-98d0-c4a7cb953117 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:56.953737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 76/147] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:56.981151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20ce5b-5bb0-4244-8bb0-61f7e84eb237 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:56.989028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de4177-d61b-4b39-acd1-90ec636f2d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:56.989928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de4177-d61b-4b39-acd1-90ec636f2d70 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:56.991294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de4177-d61b-4b39-acd1-90ec636f2d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:56.991294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de4177-d61b-4b39-acd1-90ec636f2d70 None admin] PATH_INFO: `/v3/users/591f19d8f9474871954e94e1564b1556` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:56.992108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:56.995221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de4177-d61b-4b39-acd1-90ec636f2d70 None admin] RBAC: Authorizing `identity:get_user(user_id=591f19d8f9474871954e94e1564b1556)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:56.996752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de4177-d61b-4b39-acd1-90ec636f2d70 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:56.998664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 72/148] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:56 2022] GET /identity/v3/users/591f19d8f9474871954e94e1564b1556 => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:57.005591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de4177-d61b-4b39-acd1-90ec636f2d70 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:57.150098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20ce5b-5bb0-4244-8bb0-61f7e84eb237 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:57.158360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de4177-d61b-4b39-acd1-90ec636f2d70 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:57.182940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:57.214889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6f79b-fb96-4bd0-ac4f-b79c173f58bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:57.215693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f79b-fb96-4bd0-ac4f-b79c173f58bc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:57.216003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f79b-fb96-4bd0-ac4f-b79c173f58bc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:57.216816 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f79b-fb96-4bd0-ac4f-b79c173f58bc None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:57.218396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6f79b-fb96-4bd0-ac4f-b79c173f58bc None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:57.220263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6f79b-fb96-4bd0-ac4f-b79c173f58bc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:57.222809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 73/149] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:57 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:57.231851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6f79b-fb96-4bd0-ac4f-b79c173f58bc None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:57.239001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cd33-bbc4-436d-a465-3a9b32b006dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:57.240682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cd33-bbc4-436d-a465-3a9b32b006dd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:57.241167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cd33-bbc4-436d-a465-3a9b32b006dd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:57.241649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cd33-bbc4-436d-a465-3a9b32b006dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:57.265026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1cd33-bbc4-436d-a465-3a9b32b006dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f2c1cd33-bbc4-436d-a465-3a9b32b006dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:57.276051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:57.276914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:54:57.277659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 77/150] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:54:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:54:57.286658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cd33-bbc4-436d-a465-3a9b32b006dd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:57.425193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6f79b-fb96-4bd0-ac4f-b79c173f58bc None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:57.427032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:57.485628 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cd33-bbc4-436d-a465-3a9b32b006dd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:57.498526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b7e3-e7f2-4404-b82b-a22d5ba37293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:57.499772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b7e3-e7f2-4404-b82b-a22d5ba37293 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:57.500290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b7e3-e7f2-4404-b82b-a22d5ba37293 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:57.500774 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b7e3-e7f2-4404-b82b-a22d5ba37293 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/users/591f19d8f9474871954e94e1564b1556/roles/57d52c1b0a1443818028148b95eb44f6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:57.509667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69b7e3-e7f2-4404-b82b-a22d5ba37293 None admin] RBAC: Authorizing `identity:create_grant(project_id=9664179425e34ff98312ac1c4cdc1f0a, user_id=591f19d8f9474871954e94e1564b1556, role_id=57d52c1b0a1443818028148b95eb44f6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:57.511476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69b7e3-e7f2-4404-b82b-a22d5ba37293 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:57.527595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c243d-ec40-44b4-a13f-b353ca8c361d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:57.528368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c243d-ec40-44b4-a13f-b353ca8c361d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:57.528752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c243d-ec40-44b4-a13f-b353ca8c361d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:57.529047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c243d-ec40-44b4-a13f-b353ca8c361d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:57.529822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c243d-ec40-44b4-a13f-b353ca8c361d None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:57.530190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c243d-ec40-44b4-a13f-b353ca8c361d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:57.531599 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c243d-ec40-44b4-a13f-b353ca8c361d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:57.544570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 78/151] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:54:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:57.551701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c243d-ec40-44b4-a13f-b353ca8c361d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:57.594418 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 74/152] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:54:57 2022] PUT /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/users/591f19d8f9474871954e94e1564b1556/roles/57d52c1b0a1443818028148b95eb44f6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:54:57.689108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c243d-ec40-44b4-a13f-b353ca8c361d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:57.723438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:57.740600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3828ef1-fa0e-44ab-be24-57421f790200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:57.740600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3828ef1-fa0e-44ab-be24-57421f790200 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:57.740600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3828ef1-fa0e-44ab-be24-57421f790200 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:57.740600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3828ef1-fa0e-44ab-be24-57421f790200 None admin] PATH_INFO: `/v3/users/f20f5723be9f401d87512332d772d548` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:57.740981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3828ef1-fa0e-44ab-be24-57421f790200 None admin] RBAC: Authorizing `identity:get_user(user_id=f20f5723be9f401d87512332d772d548)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:57.741239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3828ef1-fa0e-44ab-be24-57421f790200 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:57.742990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 79/153] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:57 2022] GET /identity/v3/users/f20f5723be9f401d87512332d772d548 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:57.748861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b7e3-e7f2-4404-b82b-a22d5ba37293 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:57.818104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:57.883924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b7e3-e7f2-4404-b82b-a22d5ba37293 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:57.921298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a4bf2-89bf-4d85-b857-535e19eedaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:57.921976 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4bf2-89bf-4d85-b857-535e19eedaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:57.922270 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4bf2-89bf-4d85-b857-535e19eedaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:57.922549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4bf2-89bf-4d85-b857-535e19eedaf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:58.010253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a4bf2-89bf-4d85-b857-535e19eedaf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:58.011685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a4bf2-89bf-4d85-b857-535e19eedaf4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:58.063138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:58.122996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 75/154] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:54:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:54:58.130350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3828ef1-fa0e-44ab-be24-57421f790200 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:58.235511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3828ef1-fa0e-44ab-be24-57421f790200 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:58.248461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d434ff-2888-4ecb-a82e-aa3a0ab0a87d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:58.248753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d434ff-2888-4ecb-a82e-aa3a0ab0a87d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:58.249032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d434ff-2888-4ecb-a82e-aa3a0ab0a87d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:58.250706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 76/155] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:58.255115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2a8e4-7547-4718-9c0e-527660efa33c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:58.255400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2a8e4-7547-4718-9c0e-527660efa33c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:58.255709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2a8e4-7547-4718-9c0e-527660efa33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:58.281810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d5f2a8e4-7547-4718-9c0e-527660efa33c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:58.282924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d5f2a8e4-7547-4718-9c0e-527660efa33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:58.305771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e503-0950-461e-9680-9060b282aea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:58.306654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e503-0950-461e-9680-9060b282aea6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:58.306940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e503-0950-461e-9680-9060b282aea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:58.307217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e503-0950-461e-9680-9060b282aea6 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:58.309133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9e503-0950-461e-9680-9060b282aea6 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:58.310597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9e503-0950-461e-9680-9060b282aea6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:58.312403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 80/156] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:58 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:58.328238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e503-0950-461e-9680-9060b282aea6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:58.405405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:58.437390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 77/157] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:54:58.441438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e503-0950-461e-9680-9060b282aea6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:58.478574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2a8e4-7547-4718-9c0e-527660efa33c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:58.480544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800ad4d-bdaf-48f0-a42a-54bc53cc5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:58.481418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800ad4d-bdaf-48f0-a42a-54bc53cc5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:58.481706 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800ad4d-bdaf-48f0-a42a-54bc53cc5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:58.481983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800ad4d-bdaf-48f0-a42a-54bc53cc5fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:58.482844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800ad4d-bdaf-48f0-a42a-54bc53cc5fb7 None admin] RBAC: Adding query filter params (role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a, user.id=f20f5723be9f401d87512332d772d548) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:58.483159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800ad4d-bdaf-48f0-a42a-54bc53cc5fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:58.484644 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800ad4d-bdaf-48f0-a42a-54bc53cc5fb7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:58.492047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 81/158] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:54:58 2022] GET /identity/v3/role_assignments?user.id=f20f5723be9f401d87512332d772d548&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:54:58.620454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:58.663032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2a8e4-7547-4718-9c0e-527660efa33c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:58.706940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be221f-9467-44f7-9671-8f4cca01493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:58.707760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be221f-9467-44f7-9671-8f4cca01493d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:58.708065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be221f-9467-44f7-9671-8f4cca01493d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:58.708339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be221f-9467-44f7-9671-8f4cca01493d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:58.723549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be221f-9467-44f7-9671-8f4cca01493d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-54be221f-9467-44f7-9671-8f4cca01493d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:54:58.732254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:54:58.733158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:54:58.733978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 78/159] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:54:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:54:58.739270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800ad4d-bdaf-48f0-a42a-54bc53cc5fb7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:58.891140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800ad4d-bdaf-48f0-a42a-54bc53cc5fb7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:58.924874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:58.934445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a402381-117a-4828-9ccd-5e67c24ce9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:58.935461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a402381-117a-4828-9ccd-5e67c24ce9dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:58.935758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a402381-117a-4828-9ccd-5e67c24ce9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:58.936063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a402381-117a-4828-9ccd-5e67c24ce9dc None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:58.936830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a402381-117a-4828-9ccd-5e67c24ce9dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:54:58.943277 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a402381-117a-4828-9ccd-5e67c24ce9dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:58.943277 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a402381-117a-4828-9ccd-5e67c24ce9dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:58.947924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 82/160] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:54:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:58.957493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be221f-9467-44f7-9671-8f4cca01493d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:59.092416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be221f-9467-44f7-9671-8f4cca01493d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:59.132358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:59.138630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398fd2-30d7-450d-b9f1-aaa56be263b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:59.143565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398fd2-30d7-450d-b9f1-aaa56be263b6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:59.143565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398fd2-30d7-450d-b9f1-aaa56be263b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:59.143565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398fd2-30d7-450d-b9f1-aaa56be263b6 None admin] PATH_INFO: `/v3/users/f20f5723be9f401d87512332d772d548` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:59.144606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398fd2-30d7-450d-b9f1-aaa56be263b6 None admin] RBAC: Authorizing `identity:get_user(user_id=f20f5723be9f401d87512332d772d548)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:59.146073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398fd2-30d7-450d-b9f1-aaa56be263b6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:59.148616 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 79/161] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:54:58 2022] GET /identity/v3/users/f20f5723be9f401d87512332d772d548 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:59.154093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a402381-117a-4828-9ccd-5e67c24ce9dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:59.293511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a402381-117a-4828-9ccd-5e67c24ce9dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:59.339952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4aff65-0dab-4179-83d4-f91ce7136f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:59.340612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4aff65-0dab-4179-83d4-f91ce7136f7f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:59.340896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4aff65-0dab-4179-83d4-f91ce7136f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:59.341174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4aff65-0dab-4179-83d4-f91ce7136f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:59.414202 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:59.424370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4aff65-0dab-4179-83d4-f91ce7136f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:59.432565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4aff65-0dab-4179-83d4-f91ce7136f7f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:59.564218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 83/162] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:54:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:54:59.569707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398fd2-30d7-450d-b9f1-aaa56be263b6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:59.735831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398fd2-30d7-450d-b9f1-aaa56be263b6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:54:59.788601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fb26e-ec8c-4a80-a936-1cff7ec01252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:54:59.789480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fb26e-ec8c-4a80-a936-1cff7ec01252 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:59.789768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fb26e-ec8c-4a80-a936-1cff7ec01252 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:59.790043 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fb26e-ec8c-4a80-a936-1cff7ec01252 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:59.791277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fb26e-ec8c-4a80-a936-1cff7ec01252 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:54:59.792770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fb26e-ec8c-4a80-a936-1cff7ec01252 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:54:59.794475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 80/163] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:54:59 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:54:59.800288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4aff65-0dab-4179-83d4-f91ce7136f7f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:54:59.810402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61c49b-015b-4f04-b19f-594c8771efd7 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:59.810700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61c49b-015b-4f04-b19f-594c8771efd7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:59.810956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61c49b-015b-4f04-b19f-594c8771efd7 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:59.812349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 81/164] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:54:59.819419 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e668f0-f7b0-433e-b6af-badc6045c121 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:54:59.819700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e668f0-f7b0-433e-b6af-badc6045c121 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:54:59.820001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e668f0-f7b0-433e-b6af-badc6045c121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:54:59.849236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-01e668f0-f7b0-433e-b6af-badc6045c121 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:54:59.851904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-01e668f0-f7b0-433e-b6af-badc6045c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:54:59.928487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:54:59.940182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4aff65-0dab-4179-83d4-f91ce7136f7f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:00.000084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f491d69-5d19-4ab0-b8e1-55521d754b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:00.000920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f491d69-5d19-4ab0-b8e1-55521d754b0a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:00.001769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:00.002265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f491d69-5d19-4ab0-b8e1-55521d754b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:00.002522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f491d69-5d19-4ab0-b8e1-55521d754b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:00.003677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f491d69-5d19-4ab0-b8e1-55521d754b0a None admin] RBAC: Adding query filter params (role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a, user.id=f20f5723be9f401d87512332d772d548) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:00.004022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f491d69-5d19-4ab0-b8e1-55521d754b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:00.006245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f491d69-5d19-4ab0-b8e1-55521d754b0a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:00.017234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 84/165] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:54:59 2022] GET /identity/v3/role_assignments?user.id=f20f5723be9f401d87512332d772d548&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=478978f29ae748188de8d1a31490bb00 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:00.018551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 82/166] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:00.068209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f491d69-5d19-4ab0-b8e1-55521d754b0a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:00.221452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f491d69-5d19-4ab0-b8e1-55521d754b0a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:00.273216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ab55-714d-45b3-aaa1-f7d4976f686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:00.273945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ab55-714d-45b3-aaa1-f7d4976f686d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:00.274227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ab55-714d-45b3-aaa1-f7d4976f686d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:00.274500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01ab55-714d-45b3-aaa1-f7d4976f686d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:00.288892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01ab55-714d-45b3-aaa1-f7d4976f686d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-bc01ab55-714d-45b3-aaa1-f7d4976f686d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:00.296569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:00.297442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:00.298412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 85/167] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:55:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:00.306157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e668f0-f7b0-433e-b6af-badc6045c121 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:00.443988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e668f0-f7b0-433e-b6af-badc6045c121 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:00.495486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e1614-f8ef-41a8-9f07-b4788b53c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:00.496381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e1614-f8ef-41a8-9f07-b4788b53c670 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:00.496661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e1614-f8ef-41a8-9f07-b4788b53c670 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:00.496935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e1614-f8ef-41a8-9f07-b4788b53c670 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:00.497701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e1614-f8ef-41a8-9f07-b4788b53c670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:00.498008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e1614-f8ef-41a8-9f07-b4788b53c670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:00.499400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e1614-f8ef-41a8-9f07-b4788b53c670 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:00.510110 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 83/168] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:00.516227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ab55-714d-45b3-aaa1-f7d4976f686d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:00.542638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:00.659028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01ab55-714d-45b3-aaa1-f7d4976f686d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:00.702267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e3d68-2939-484f-a109-68a9a4227ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:00.703144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e3d68-2939-484f-a109-68a9a4227ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:00.703426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e3d68-2939-484f-a109-68a9a4227ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:00.703698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e3d68-2939-484f-a109-68a9a4227ca7 None admin] PATH_INFO: `/v3/users/5dacf821834c434a822a5d4f64c8fbf6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:00.708654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e3d68-2939-484f-a109-68a9a4227ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=5dacf821834c434a822a5d4f64c8fbf6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:00.710653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e3d68-2939-484f-a109-68a9a4227ca7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:00.712369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 86/169] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:00 2022] GET /identity/v3/users/5dacf821834c434a822a5d4f64c8fbf6 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:00.718141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e1614-f8ef-41a8-9f07-b4788b53c670 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:00.788844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:00.824164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4446-44ab-4f61-98e0-b80b20ff1121 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:00.824467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4446-44ab-4f61-98e0-b80b20ff1121 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:00.824722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c4446-44ab-4f61-98e0-b80b20ff1121 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:00.826102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 87/170] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:00.831461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5aab-bff4-4f82-80d6-728c95a69834 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:00.831835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5aab-bff4-4f82-80d6-728c95a69834 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:00.832140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5aab-bff4-4f82-80d6-728c95a69834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:00.860065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e1614-f8ef-41a8-9f07-b4788b53c670 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:00.862487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c79d5aab-bff4-4f82-80d6-728c95a69834 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:00.863673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c79d5aab-bff4-4f82-80d6-728c95a69834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:00.925575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8010499-8333-441b-a057-5413b77e81d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:00.926306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010499-8333-441b-a057-5413b77e81d9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:00.926587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010499-8333-441b-a057-5413b77e81d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:00.926862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8010499-8333-441b-a057-5413b77e81d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.005147 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 88/171] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:01.034977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010499-8333-441b-a057-5413b77e81d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:01.036494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8010499-8333-441b-a057-5413b77e81d9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:01.051620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d5aab-bff4-4f82-80d6-728c95a69834 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:01.104267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:01.142382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:01.203720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d5aab-bff4-4f82-80d6-728c95a69834 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:01.206713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 84/172] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:01.208106 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647751d-bef2-4793-9ab9-cac2dcbcb8ae None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.208407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647751d-bef2-4793-9ab9-cac2dcbcb8ae None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.208806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647751d-bef2-4793-9ab9-cac2dcbcb8ae None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.211023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 85/173] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:01.212018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade612ff-e964-4e59-ae5d-66b7a8fcb5c8 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.212304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade612ff-e964-4e59-ae5d-66b7a8fcb5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.212583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade612ff-e964-4e59-ae5d-66b7a8fcb5c8 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.213828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 86/174] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:01.219545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9db13-2689-4d67-bc2d-37f43dbdb207 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.219836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9db13-2689-4d67-bc2d-37f43dbdb207 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.220149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9db13-2689-4d67-bc2d-37f43dbdb207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.238793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f4d9db13-2689-4d67-bc2d-37f43dbdb207 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:01.240175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f4d9db13-2689-4d67-bc2d-37f43dbdb207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:01.248484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b40d28-2e46-4464-bc2d-75b5a5d164aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:01.249413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40d28-2e46-4464-bc2d-75b5a5d164aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.249799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40d28-2e46-4464-bc2d-75b5a5d164aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.250172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40d28-2e46-4464-bc2d-75b5a5d164aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.264825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b40d28-2e46-4464-bc2d-75b5a5d164aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-94b40d28-2e46-4464-bc2d-75b5a5d164aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:01.275234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:01.276250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:01.277024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 89/175] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:01.278197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6c55-0e3d-4253-81eb-df7d43c1b825 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.278197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6c55-0e3d-4253-81eb-df7d43c1b825 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.278367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6c55-0e3d-4253-81eb-df7d43c1b825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.296366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4a3b6c55-0e3d-4253-81eb-df7d43c1b825 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:01.297572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a3b6c55-0e3d-4253-81eb-df7d43c1b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:01.315197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 87/176] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:01.316237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9db13-2689-4d67-bc2d-37f43dbdb207 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:01.383900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 90/177] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:01.392181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e46d-ba01-4fc8-b8ec-db989d878287 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.392181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e46d-ba01-4fc8-b8ec-db989d878287 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.392181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e46d-ba01-4fc8-b8ec-db989d878287 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.392181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 91/178] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:01.392181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44e46d-ba01-4fc8-b8ec-db989d878287 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:01.404218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:01.418756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:01.432082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9db13-2689-4d67-bc2d-37f43dbdb207 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:01.468152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a283e3-b25e-41dc-81a8-ba07a2a7dad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:01.469289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a283e3-b25e-41dc-81a8-ba07a2a7dad9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.469571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a283e3-b25e-41dc-81a8-ba07a2a7dad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.469846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a283e3-b25e-41dc-81a8-ba07a2a7dad9 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.472253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a283e3-b25e-41dc-81a8-ba07a2a7dad9 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:01.473725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a283e3-b25e-41dc-81a8-ba07a2a7dad9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:01.475637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 88/179] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:01 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:01.479099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a283e3-b25e-41dc-81a8-ba07a2a7dad9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:01.514448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44e46d-ba01-4fc8-b8ec-db989d878287 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:01.561314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e002bb3-f91d-415b-b00e-44ccb922ca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:01.561996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e002bb3-f91d-415b-b00e-44ccb922ca7d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.562286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e002bb3-f91d-415b-b00e-44ccb922ca7d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.562568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e002bb3-f91d-415b-b00e-44ccb922ca7d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.563333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e002bb3-f91d-415b-b00e-44ccb922ca7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:01.563646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e002bb3-f91d-415b-b00e-44ccb922ca7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:01.565367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e002bb3-f91d-415b-b00e-44ccb922ca7d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:01.574539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 92/180] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:01.575848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858433e-f0ea-4299-a061-824422f6742b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.576168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858433e-f0ea-4299-a061-824422f6742b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.576449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858433e-f0ea-4299-a061-824422f6742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.587235 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a283e3-b25e-41dc-81a8-ba07a2a7dad9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:01.592880 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f858433e-f0ea-4299-a061-824422f6742b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:01.594081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f858433e-f0ea-4299-a061-824422f6742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:01.624640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48e4b9-6028-4c5d-8b65-06f456465cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:01.625484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48e4b9-6028-4c5d-8b65-06f456465cca None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.625733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48e4b9-6028-4c5d-8b65-06f456465cca None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.625998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48e4b9-6028-4c5d-8b65-06f456465cca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.637386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48e4b9-6028-4c5d-8b65-06f456465cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-4e48e4b9-6028-4c5d-8b65-06f456465cca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:01.645421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:01.646465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:01.647269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 89/181] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:01.647945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48e4b9-6028-4c5d-8b65-06f456465cca None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:01.661551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:01.669187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:01.670192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 93/182] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:01.680059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858433e-f0ea-4299-a061-824422f6742b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:01.767073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48e4b9-6028-4c5d-8b65-06f456465cca None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:01.785245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858433e-f0ea-4299-a061-824422f6742b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:01.799806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75182a0f-716a-4274-a19a-3d4a855beaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:01.800629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75182a0f-716a-4274-a19a-3d4a855beaae None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.800911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75182a0f-716a-4274-a19a-3d4a855beaae None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.801186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75182a0f-716a-4274-a19a-3d4a855beaae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.811701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75182a0f-716a-4274-a19a-3d4a855beaae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:01.818827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd348f-92c9-48ca-a418-da92d9e8a7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-75182a0f-716a-4274-a19a-3d4a855beaae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:01.819399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:01.820454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:01.821684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:01.822408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd348f-92c9-48ca-a418-da92d9e8a7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.822408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd348f-92c9-48ca-a418-da92d9e8a7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.822408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd348f-92c9-48ca-a418-da92d9e8a7e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.822595 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 90/183] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:55:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:01.822668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd348f-92c9-48ca-a418-da92d9e8a7e4 None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a, user.id=5dacf821834c434a822a5d4f64c8fbf6) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:01.822668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd348f-92c9-48ca-a418-da92d9e8a7e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:01.822668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd348f-92c9-48ca-a418-da92d9e8a7e4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:01.823806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75182a0f-716a-4274-a19a-3d4a855beaae None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:01.828596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 94/184] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:01 2022] GET /identity/v3/role_assignments?user.id=5dacf821834c434a822a5d4f64c8fbf6&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:01.829367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd348f-92c9-48ca-a418-da92d9e8a7e4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:01.902762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:01.921485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:01.946878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75182a0f-716a-4274-a19a-3d4a855beaae None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:01.952833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd348f-92c9-48ca-a418-da92d9e8a7e4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:01.987929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9aa08-7aba-40fe-b4fc-b26be9e43933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:01.988807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9aa08-7aba-40fe-b4fc-b26be9e43933 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:01.990826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9aa08-7aba-40fe-b4fc-b26be9e43933 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:01.990826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9aa08-7aba-40fe-b4fc-b26be9e43933 None admin] PATH_INFO: `/v3/users/f20f5723be9f401d87512332d772d548` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:01.991152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9aa08-7aba-40fe-b4fc-b26be9e43933 None admin] RBAC: Authorizing `identity:get_user(user_id=f20f5723be9f401d87512332d772d548)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:01.993483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9aa08-7aba-40fe-b4fc-b26be9e43933 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:01.995139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 91/185] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:01 2022] GET /identity/v3/users/f20f5723be9f401d87512332d772d548 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:01.996593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9aa08-7aba-40fe-b4fc-b26be9e43933 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:01.999402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152f503-6c6e-44f8-beec-caecf1c337bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:02.000328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f503-6c6e-44f8-beec-caecf1c337bd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.000616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f503-6c6e-44f8-beec-caecf1c337bd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.000894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f503-6c6e-44f8-beec-caecf1c337bd None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.001666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152f503-6c6e-44f8-beec-caecf1c337bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:02.001978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152f503-6c6e-44f8-beec-caecf1c337bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:02.003381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152f503-6c6e-44f8-beec-caecf1c337bd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:02.012697 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 95/186] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:02.013800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183163ab-f8b4-4ed0-aa92-57099796df89 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.014088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183163ab-f8b4-4ed0-aa92-57099796df89 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.014363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183163ab-f8b4-4ed0-aa92-57099796df89 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.015623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 96/187] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:02.016348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183163ab-f8b4-4ed0-aa92-57099796df89 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:02.113276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9aa08-7aba-40fe-b4fc-b26be9e43933 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:02.127458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183163ab-f8b4-4ed0-aa92-57099796df89 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:02.147013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:02.148019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fb9db-3346-4724-8156-2265ce2ad052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:02.148810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fb9db-3346-4724-8156-2265ce2ad052 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.149105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fb9db-3346-4724-8156-2265ce2ad052 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.149371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fb9db-3346-4724-8156-2265ce2ad052 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.150559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fb9db-3346-4724-8156-2265ce2ad052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:02.152065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fb9db-3346-4724-8156-2265ce2ad052 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:02.153693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 92/188] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:02.154777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fb9db-3346-4724-8156-2265ce2ad052 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:02.162664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e376a-5e8b-45b6-bdbb-888df91a5f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:02.163337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e376a-5e8b-45b6-bdbb-888df91a5f5c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.163622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e376a-5e8b-45b6-bdbb-888df91a5f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.163925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e376a-5e8b-45b6-bdbb-888df91a5f5c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.164683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e376a-5e8b-45b6-bdbb-888df91a5f5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:02.164991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e376a-5e8b-45b6-bdbb-888df91a5f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:02.166384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e376a-5e8b-45b6-bdbb-888df91a5f5c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:02.169758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:02.175045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 97/189] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:02.176753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e376a-5e8b-45b6-bdbb-888df91a5f5c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:02.254170 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fb9db-3346-4724-8156-2265ce2ad052 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:02.276092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e376a-5e8b-45b6-bdbb-888df91a5f5c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:02.288324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230212e-c1e2-4af2-a9b5-2d8f63ef1874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:02.288977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230212e-c1e2-4af2-a9b5-2d8f63ef1874 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.289264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230212e-c1e2-4af2-a9b5-2d8f63ef1874 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.289545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230212e-c1e2-4af2-a9b5-2d8f63ef1874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.309719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe0a4b-4b35-4afe-894d-02baba87c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:02.310584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe0a4b-4b35-4afe-894d-02baba87c6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.310870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe0a4b-4b35-4afe-894d-02baba87c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.311141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe0a4b-4b35-4afe-894d-02baba87c6a0 None admin] PATH_INFO: `/v3/users/36bee41bd5884f74beaf36f258561cde` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.324101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe0a4b-4b35-4afe-894d-02baba87c6a0 None admin] RBAC: Authorizing `identity:get_user(user_id=36bee41bd5884f74beaf36f258561cde)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:02.325546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe0a4b-4b35-4afe-894d-02baba87c6a0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:02.327228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 98/190] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:02 2022] GET /identity/v3/users/36bee41bd5884f74beaf36f258561cde => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:02.328412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2511d-763d-46bd-829b-b09ea21a6c35 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.328699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2511d-763d-46bd-829b-b09ea21a6c35 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.328978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2511d-763d-46bd-829b-b09ea21a6c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.346429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-01e2511d-763d-46bd-829b-b09ea21a6c35 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:02.347635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-01e2511d-763d-46bd-829b-b09ea21a6c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:02.356618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230212e-c1e2-4af2-a9b5-2d8f63ef1874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:02.358112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230212e-c1e2-4af2-a9b5-2d8f63ef1874 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:02.372893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:02.381965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:02.413827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 99/191] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:02.414811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2511d-763d-46bd-829b-b09ea21a6c35 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:02.464601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 93/192] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:02.464601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230212e-c1e2-4af2-a9b5-2d8f63ef1874 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:02.516373 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2511d-763d-46bd-829b-b09ea21a6c35 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:02.551081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7b67e-3698-4c9f-abf4-8ae01539b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:02.551764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7b67e-3698-4c9f-abf4-8ae01539b476 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.552101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7b67e-3698-4c9f-abf4-8ae01539b476 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.552412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7b67e-3698-4c9f-abf4-8ae01539b476 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.553241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7b67e-3698-4c9f-abf4-8ae01539b476 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:02.554690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7b67e-3698-4c9f-abf4-8ae01539b476 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:02.560640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230212e-c1e2-4af2-a9b5-2d8f63ef1874 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:02.574498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:02.594891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d8f7f-b769-411b-854a-684ed0f41b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:02.595755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d8f7f-b769-411b-854a-684ed0f41b8d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.596080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d8f7f-b769-411b-854a-684ed0f41b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.596357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d8f7f-b769-411b-854a-684ed0f41b8d None admin] PATH_INFO: `/v3/users/36bee41bd5884f74beaf36f258561cde` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.597543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d8f7f-b769-411b-854a-684ed0f41b8d None admin] RBAC: Authorizing `identity:get_user(user_id=36bee41bd5884f74beaf36f258561cde)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:02.599005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d8f7f-b769-411b-854a-684ed0f41b8d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:02.602489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 94/193] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:02 2022] GET /identity/v3/users/36bee41bd5884f74beaf36f258561cde => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:02.603347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d8f7f-b769-411b-854a-684ed0f41b8d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:02.640240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 100/194] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:55:02 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:55:02.641029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7b67e-3698-4c9f-abf4-8ae01539b476 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:02.694158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:02.710644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d8f7f-b769-411b-854a-684ed0f41b8d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:02.748867 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442e3dd-5ea8-43db-af6e-87d19747a653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:02.749537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442e3dd-5ea8-43db-af6e-87d19747a653 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.749822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442e3dd-5ea8-43db-af6e-87d19747a653 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.750097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442e3dd-5ea8-43db-af6e-87d19747a653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.780440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7b67e-3698-4c9f-abf4-8ae01539b476 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:02.805442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:02.822734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1bc93-11fb-40ea-bc37-603dffeefc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:02.823537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1bc93-11fb-40ea-bc37-603dffeefc13 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:02.824365 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1bc93-11fb-40ea-bc37-603dffeefc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:02.824365 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1bc93-11fb-40ea-bc37-603dffeefc13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:02.830330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442e3dd-5ea8-43db-af6e-87d19747a653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:02.831817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442e3dd-5ea8-43db-af6e-87d19747a653 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:02.839016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1bc93-11fb-40ea-bc37-603dffeefc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fce1bc93-11fb-40ea-bc37-603dffeefc13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:02.848060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:02.848926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:02.849766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 101/195] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:02.850417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1bc93-11fb-40ea-bc37-603dffeefc13 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:02.958102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:02.968704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 95/196] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:02.971976 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442e3dd-5ea8-43db-af6e-87d19747a653 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:02.976470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1bc93-11fb-40ea-bc37-603dffeefc13 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.022633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d4790-ade7-4b0e-8d95-40a952e5e6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:03.023781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d4790-ade7-4b0e-8d95-40a952e5e6fb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:03.024415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d4790-ade7-4b0e-8d95-40a952e5e6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:03.024763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d4790-ade7-4b0e-8d95-40a952e5e6fb None admin] PATH_INFO: `/v3/projects/e6428f12b1e54a76b5df0d7d282ee98c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:03.026819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d4790-ade7-4b0e-8d95-40a952e5e6fb None admin] RBAC: Authorizing `identity:get_project(project_id=e6428f12b1e54a76b5df0d7d282ee98c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:03.029021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d4790-ade7-4b0e-8d95-40a952e5e6fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:03.030836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 102/197] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:02 2022] GET /identity/v3/projects/e6428f12b1e54a76b5df0d7d282ee98c => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:03.032255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d4790-ade7-4b0e-8d95-40a952e5e6fb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:03.065367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:03.086425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442e3dd-5ea8-43db-af6e-87d19747a653 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.124018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714d12c-2b07-4697-becc-67c9382dcc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:03.124828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714d12c-2b07-4697-becc-67c9382dcc43 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:03.125260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714d12c-2b07-4697-becc-67c9382dcc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:03.125601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714d12c-2b07-4697-becc-67c9382dcc43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:03.165948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d4790-ade7-4b0e-8d95-40a952e5e6fb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.201036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714d12c-2b07-4697-becc-67c9382dcc43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:03.202891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714d12c-2b07-4697-becc-67c9382dcc43 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:03.212503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c324-59f2-4975-bd2d-a3c26025eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:03.213120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c324-59f2-4975-bd2d-a3c26025eb1c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:03.213875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c324-59f2-4975-bd2d-a3c26025eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:03.214166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c324-59f2-4975-bd2d-a3c26025eb1c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:03.214940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c324-59f2-4975-bd2d-a3c26025eb1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:03.215675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c324-59f2-4975-bd2d-a3c26025eb1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:03.217379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c324-59f2-4975-bd2d-a3c26025eb1c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:03.229484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 103/198] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:03.230730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c324-59f2-4975-bd2d-a3c26025eb1c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:03.256223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:03.310065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:03.331721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 96/199] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:03.333073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714d12c-2b07-4697-becc-67c9382dcc43 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:03.342702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c324-59f2-4975-bd2d-a3c26025eb1c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.377730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafed6e6-65b1-44ca-a041-c6f81a03eb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:03.378930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafed6e6-65b1-44ca-a041-c6f81a03eb4c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:03.378930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafed6e6-65b1-44ca-a041-c6f81a03eb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:03.379245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafed6e6-65b1-44ca-a041-c6f81a03eb4c None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:03.381129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafed6e6-65b1-44ca-a041-c6f81a03eb4c None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:03.382875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafed6e6-65b1-44ca-a041-c6f81a03eb4c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:03.389369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 104/200] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:03 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:03.389369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafed6e6-65b1-44ca-a041-c6f81a03eb4c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:03.453741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714d12c-2b07-4697-becc-67c9382dcc43 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.472231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:03.488268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafed6e6-65b1-44ca-a041-c6f81a03eb4c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.494074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708fa4c-dc43-4905-8473-6257ed9bac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:03.494996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708fa4c-dc43-4905-8473-6257ed9bac0d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:03.495437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708fa4c-dc43-4905-8473-6257ed9bac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:03.495793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708fa4c-dc43-4905-8473-6257ed9bac0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:03.497179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708fa4c-dc43-4905-8473-6257ed9bac0d None admin] RBAC: Adding query filter params (role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=e6428f12b1e54a76b5df0d7d282ee98c, user.id=f20f5723be9f401d87512332d772d548) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:03.497505 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708fa4c-dc43-4905-8473-6257ed9bac0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:03.499501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708fa4c-dc43-4905-8473-6257ed9bac0d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:03.509007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 97/201] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:03 2022] GET /identity/v3/role_assignments?user.id=f20f5723be9f401d87512332d772d548&scope.project.id=e6428f12b1e54a76b5df0d7d282ee98c&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:03.509846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708fa4c-dc43-4905-8473-6257ed9bac0d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:03.537672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7b359-f715-4735-891b-71fe964fc2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:03.538633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7b359-f715-4735-891b-71fe964fc2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:03.538918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7b359-f715-4735-891b-71fe964fc2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:03.539191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7b359-f715-4735-891b-71fe964fc2b6 None admin] PATH_INFO: `/v3/users/591f19d8f9474871954e94e1564b1556` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:03.540604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7b359-f715-4735-891b-71fe964fc2b6 None admin] RBAC: Authorizing `identity:get_user(user_id=591f19d8f9474871954e94e1564b1556)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:03.542177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7b359-f715-4735-891b-71fe964fc2b6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:03.544660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 105/202] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:03 2022] GET /identity/v3/users/591f19d8f9474871954e94e1564b1556 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:03.544910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7b359-f715-4735-891b-71fe964fc2b6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:03.578236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:03.649994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708fa4c-dc43-4905-8473-6257ed9bac0d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.681002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7b359-f715-4735-891b-71fe964fc2b6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.688542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d221d36-87e6-4f04-8bdc-22262f8765ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:03.689464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d221d36-87e6-4f04-8bdc-22262f8765ac None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:03.689794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d221d36-87e6-4f04-8bdc-22262f8765ac None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:03.690072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d221d36-87e6-4f04-8bdc-22262f8765ac None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:03.691269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d221d36-87e6-4f04-8bdc-22262f8765ac None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:03.692798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d221d36-87e6-4f04-8bdc-22262f8765ac None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:03.694774 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 98/203] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:03 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:03.695720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d221d36-87e6-4f04-8bdc-22262f8765ac None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:03.743205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2a0e-bd4b-43a4-b416-f61fd176cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:03.743671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2a0e-bd4b-43a4-b416-f61fd176cced None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:03.743983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2a0e-bd4b-43a4-b416-f61fd176cced None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:03.744267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2a0e-bd4b-43a4-b416-f61fd176cced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:03.745116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae2a0e-bd4b-43a4-b416-f61fd176cced None admin] RBAC: Adding query filter params (role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=a39345b421b846488684793b6a430379, user.id=36bee41bd5884f74beaf36f258561cde) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:03.745429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae2a0e-bd4b-43a4-b416-f61fd176cced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:03.750405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae2a0e-bd4b-43a4-b416-f61fd176cced None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:03.765378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 106/204] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:03 2022] GET /identity/v3/role_assignments?user.id=36bee41bd5884f74beaf36f258561cde&scope.project.id=a39345b421b846488684793b6a430379&role.id=478978f29ae748188de8d1a31490bb00 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:03.765999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2a0e-bd4b-43a4-b416-f61fd176cced None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:03.813365 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:03.906402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d221d36-87e6-4f04-8bdc-22262f8765ac None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.937271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:03.978427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2a0e-bd4b-43a4-b416-f61fd176cced None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:03.989279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bb034-2772-4b66-8bf8-fda229fa2c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:03.990748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bb034-2772-4b66-8bf8-fda229fa2c03 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:03.991640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bb034-2772-4b66-8bf8-fda229fa2c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:03.991955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bb034-2772-4b66-8bf8-fda229fa2c03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:04.045524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8423ec-0498-4768-811c-ab89086bc10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:04.046119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8423ec-0498-4768-811c-ab89086bc10b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:04.046410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8423ec-0498-4768-811c-ab89086bc10b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:04.046687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8423ec-0498-4768-811c-ab89086bc10b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:04.047562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8423ec-0498-4768-811c-ab89086bc10b None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=a39345b421b846488684793b6a430379, user.id=36bee41bd5884f74beaf36f258561cde) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:04.047908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8423ec-0498-4768-811c-ab89086bc10b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:04.051221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8423ec-0498-4768-811c-ab89086bc10b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:04.068318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 107/205] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:03 2022] GET /identity/v3/role_assignments?user.id=36bee41bd5884f74beaf36f258561cde&scope.project.id=a39345b421b846488684793b6a430379&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:04.105339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bb034-2772-4b66-8bf8-fda229fa2c03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:04.106852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bb034-2772-4b66-8bf8-fda229fa2c03 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:04.242842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 99/206] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:04.248377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8423ec-0498-4768-811c-ab89086bc10b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:04.334434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:04.363657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8423ec-0498-4768-811c-ab89086bc10b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:04.412423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43283545-09e9-48a9-98ed-42dcf5e98491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:04.413298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283545-09e9-48a9-98ed-42dcf5e98491 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:04.413585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283545-09e9-48a9-98ed-42dcf5e98491 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:04.413864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43283545-09e9-48a9-98ed-42dcf5e98491 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:04.415073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43283545-09e9-48a9-98ed-42dcf5e98491 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:04.416560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43283545-09e9-48a9-98ed-42dcf5e98491 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:04.418269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 108/207] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:04 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:04.424316 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bb034-2772-4b66-8bf8-fda229fa2c03 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:04.450410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:04.582157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bb034-2772-4b66-8bf8-fda229fa2c03 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:04.632611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e2286-f161-4ac9-ad3f-28903ac2f916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:04.633255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e2286-f161-4ac9-ad3f-28903ac2f916 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:04.633538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e2286-f161-4ac9-ad3f-28903ac2f916 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:04.633829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e2286-f161-4ac9-ad3f-28903ac2f916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:04.634699 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e2286-f161-4ac9-ad3f-28903ac2f916 None admin] RBAC: Adding query filter params (role.id=57d52c1b0a1443818028148b95eb44f6, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a, user.id=591f19d8f9474871954e94e1564b1556) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:04.635015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e2286-f161-4ac9-ad3f-28903ac2f916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:04.636522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e2286-f161-4ac9-ad3f-28903ac2f916 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:04.648738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 100/208] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:04 2022] GET /identity/v3/role_assignments?user.id=591f19d8f9474871954e94e1564b1556&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=57d52c1b0a1443818028148b95eb44f6 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:05.131140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739aa27-4d77-48ad-ab30-f3b626dc322b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.132414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739aa27-4d77-48ad-ab30-f3b626dc322b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.132414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739aa27-4d77-48ad-ab30-f3b626dc322b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.133478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 109/209] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:05.139500 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d24d-8c9e-4b9a-9f08-44446fe3b76b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.139792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d24d-8c9e-4b9a-9f08-44446fe3b76b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.140096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d24d-8c9e-4b9a-9f08-44446fe3b76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.161103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7967d24d-8c9e-4b9a-9f08-44446fe3b76b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:05.162919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7967d24d-8c9e-4b9a-9f08-44446fe3b76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:05.172410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8f4c-0e1e-4d2e-baa3-fb4ca97f7bcb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.172716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8f4c-0e1e-4d2e-baa3-fb4ca97f7bcb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.172982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8f4c-0e1e-4d2e-baa3-fb4ca97f7bcb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.174374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 110/210] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:05.181207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d148a9-8580-48c0-9a01-f501b5817809 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.181497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d148a9-8580-48c0-9a01-f501b5817809 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.181783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d148a9-8580-48c0-9a01-f501b5817809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.203051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-28d148a9-8580-48c0-9a01-f501b5817809 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:05.204285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-28d148a9-8580-48c0-9a01-f501b5817809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:05.258364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 101/211] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:05.284773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d24d-8c9e-4b9a-9f08-44446fe3b76b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:05.291342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 111/212] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:05.295738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:05.325760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d148a9-8580-48c0-9a01-f501b5817809 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:05.400845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d24d-8c9e-4b9a-9f08-44446fe3b76b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:05.425012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:05.439435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67b74-bc4a-43d3-866d-c66fecd5ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:05.440622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67b74-bc4a-43d3-866d-c66fecd5ac07 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.441107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67b74-bc4a-43d3-866d-c66fecd5ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.441579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67b74-bc4a-43d3-866d-c66fecd5ac07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.451463 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d148a9-8580-48c0-9a01-f501b5817809 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:05.453574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd67b74-bc4a-43d3-866d-c66fecd5ac07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5bd67b74-bc4a-43d3-866d-c66fecd5ac07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:05.463761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:05.464678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:05.465494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:05.472893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 102/213] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:05.474698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67b74-bc4a-43d3-866d-c66fecd5ac07 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:05.495358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f40b8f-ca4b-42fb-9ac9-b3d5b2a8795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:05.496201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f40b8f-ca4b-42fb-9ac9-b3d5b2a8795d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.496484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f40b8f-ca4b-42fb-9ac9-b3d5b2a8795d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.496915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f40b8f-ca4b-42fb-9ac9-b3d5b2a8795d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.498414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f40b8f-ca4b-42fb-9ac9-b3d5b2a8795d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:05.499890 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f40b8f-ca4b-42fb-9ac9-b3d5b2a8795d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:05.502147 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 112/214] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:05.510532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f40b8f-ca4b-42fb-9ac9-b3d5b2a8795d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:05.556641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:05.594840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67b74-bc4a-43d3-866d-c66fecd5ac07 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:05.625481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f40b8f-ca4b-42fb-9ac9-b3d5b2a8795d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:05.633873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce03b9-158b-4536-ab14-779aefd89683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:05.634313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce03b9-158b-4536-ab14-779aefd89683 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.634668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce03b9-158b-4536-ab14-779aefd89683 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.635018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce03b9-158b-4536-ab14-779aefd89683 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.635857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce03b9-158b-4536-ab14-779aefd89683 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:05.636280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce03b9-158b-4536-ab14-779aefd89683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:05.637790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce03b9-158b-4536-ab14-779aefd89683 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:05.647118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 103/215] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:05.652602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce03b9-158b-4536-ab14-779aefd89683 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:05.664837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbb719-6b5c-42b5-8948-b15c0b38ad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:05.665821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbb719-6b5c-42b5-8948-b15c0b38ad21 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.666288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbb719-6b5c-42b5-8948-b15c0b38ad21 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.666755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbb719-6b5c-42b5-8948-b15c0b38ad21 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.667651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbb719-6b5c-42b5-8948-b15c0b38ad21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:05.669348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbb719-6b5c-42b5-8948-b15c0b38ad21 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:05.759447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce03b9-158b-4536-ab14-779aefd89683 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:05.779118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 113/216] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:55:05 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:55:05.795829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:05.805473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fedda0-b306-46c9-a028-ff159a36b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:05.806482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fedda0-b306-46c9-a028-ff159a36b603 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.806773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fedda0-b306-46c9-a028-ff159a36b603 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.807048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fedda0-b306-46c9-a028-ff159a36b603 None admin] PATH_INFO: `/v3/users/9a63582f2ffd44b292d438e72d3ab762` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.824360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fedda0-b306-46c9-a028-ff159a36b603 None admin] RBAC: Authorizing `identity:get_user(user_id=9a63582f2ffd44b292d438e72d3ab762)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:05.826025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fedda0-b306-46c9-a028-ff159a36b603 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:05.827906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 104/217] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:05 2022] GET /identity/v3/users/9a63582f2ffd44b292d438e72d3ab762 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:05.835319 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbb719-6b5c-42b5-8948-b15c0b38ad21 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:05.838671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:05.953758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbb719-6b5c-42b5-8948-b15c0b38ad21 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:05.991406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2c2ff-d979-4c22-8a73-ccafe654bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:05.992178 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2c2ff-d979-4c22-8a73-ccafe654bebb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.992752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2c2ff-d979-4c22-8a73-ccafe654bebb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.993034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2c2ff-d979-4c22-8a73-ccafe654bebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:05.998109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6072c-36e1-4a6b-bdda-fb5e2607dbf2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:05.998394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6072c-36e1-4a6b-bdda-fb5e2607dbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:05.998671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6072c-36e1-4a6b-bdda-fb5e2607dbf2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:06.000095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 105/218] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:06.006772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f924b-387d-409c-92f6-273dcd965873 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:06.007159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f924b-387d-409c-92f6-273dcd965873 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:06.007453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f924b-387d-409c-92f6-273dcd965873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:06.032728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-344f924b-387d-409c-92f6-273dcd965873 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:06.033987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-344f924b-387d-409c-92f6-273dcd965873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:06.082003 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2c2ff-d979-4c22-8a73-ccafe654bebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:06.084404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2c2ff-d979-4c22-8a73-ccafe654bebb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:06.088035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:06.132508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 106/219] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:06.157453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f924b-387d-409c-92f6-273dcd965873 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:06.208623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 114/220] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:06.216935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2c2ff-d979-4c22-8a73-ccafe654bebb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:06.281320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f924b-387d-409c-92f6-273dcd965873 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:06.306450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:06.335042 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb4e1-3427-4a0d-b237-ea74d655ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:06.337741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb4e1-3427-4a0d-b237-ea74d655ae47 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:06.341278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb4e1-3427-4a0d-b237-ea74d655ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:06.341719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb4e1-3427-4a0d-b237-ea74d655ae47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:06.364039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eb4e1-3427-4a0d-b237-ea74d655ae47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:06.373514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2c2ff-d979-4c22-8a73-ccafe654bebb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:06.375334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ab3eb4e1-3427-4a0d-b237-ea74d655ae47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:06.381756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:06.382832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:06.383811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:06.386184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 107/221] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:06.394576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb4e1-3427-4a0d-b237-ea74d655ae47 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:06.441092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49805f0a-b279-4310-9a8c-8b05dae7b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:06.441965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805f0a-b279-4310-9a8c-8b05dae7b728 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:06.442294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805f0a-b279-4310-9a8c-8b05dae7b728 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:06.442572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805f0a-b279-4310-9a8c-8b05dae7b728 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:06.445472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49805f0a-b279-4310-9a8c-8b05dae7b728 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:06.446929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49805f0a-b279-4310-9a8c-8b05dae7b728 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:06.451003 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 115/222] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:06 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:06.457961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49805f0a-b279-4310-9a8c-8b05dae7b728 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:06.586580 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb4e1-3427-4a0d-b237-ea74d655ae47 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:06.604166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49805f0a-b279-4310-9a8c-8b05dae7b728 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:06.627138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82751eb2-d5ef-4955-bb46-73aae453c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:06.628184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82751eb2-d5ef-4955-bb46-73aae453c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:06.628749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82751eb2-d5ef-4955-bb46-73aae453c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:06.629314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82751eb2-d5ef-4955-bb46-73aae453c0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:06.630278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82751eb2-d5ef-4955-bb46-73aae453c0b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:06.630799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82751eb2-d5ef-4955-bb46-73aae453c0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:06.633662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82751eb2-d5ef-4955-bb46-73aae453c0b5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:06.639980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d949da3-de5c-4df4-b93d-624fe2be8ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:06.640642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949da3-de5c-4df4-b93d-624fe2be8ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:06.640935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949da3-de5c-4df4-b93d-624fe2be8ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:06.641224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949da3-de5c-4df4-b93d-624fe2be8ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:06.642037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d949da3-de5c-4df4-b93d-624fe2be8ae7 None admin] RBAC: Adding query filter params (role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=a39345b421b846488684793b6a430379, user.id=9a63582f2ffd44b292d438e72d3ab762) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:06.642350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d949da3-de5c-4df4-b93d-624fe2be8ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:06.643905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d949da3-de5c-4df4-b93d-624fe2be8ae7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:06.644335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 108/223] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:06.646441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa87596-c850-496f-9ae4-3fffe770667a None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:06.646927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa87596-c850-496f-9ae4-3fffe770667a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:06.647394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa87596-c850-496f-9ae4-3fffe770667a None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:06.653042 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 109/224] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:06.654136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa87596-c850-496f-9ae4-3fffe770667a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:06.655374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 116/225] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:06 2022] GET /identity/v3/role_assignments?user.id=9a63582f2ffd44b292d438e72d3ab762&scope.project.id=a39345b421b846488684793b6a430379&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:06.665308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b753c-f195-4f78-9e2b-dc428d97ce42 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:06.665308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b753c-f195-4f78-9e2b-dc428d97ce42 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:06.665582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b753c-f195-4f78-9e2b-dc428d97ce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:06.686109 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ea5b753c-f195-4f78-9e2b-dc428d97ce42 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:06.687331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea5b753c-f195-4f78-9e2b-dc428d97ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:06.721590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:06.752360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:06.767094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 117/226] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:06.796824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b753c-f195-4f78-9e2b-dc428d97ce42 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:06.880107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa87596-c850-496f-9ae4-3fffe770667a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:06.917428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ac42a-78e2-4b02-8fb3-e606294b912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:06.918601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ac42a-78e2-4b02-8fb3-e606294b912a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:06.919104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ac42a-78e2-4b02-8fb3-e606294b912a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:06.919548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ac42a-78e2-4b02-8fb3-e606294b912a None admin] PATH_INFO: `/v3/users/36bee41bd5884f74beaf36f258561cde` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:06.921006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ac42a-78e2-4b02-8fb3-e606294b912a None admin] RBAC: Authorizing `identity:get_user(user_id=36bee41bd5884f74beaf36f258561cde)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:06.922686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ac42a-78e2-4b02-8fb3-e606294b912a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:06.924568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 110/227] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:06 2022] GET /identity/v3/users/36bee41bd5884f74beaf36f258561cde => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:06.930897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ac42a-78e2-4b02-8fb3-e606294b912a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:06.944049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b753c-f195-4f78-9e2b-dc428d97ce42 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:07.024641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead9684-5444-4f3f-a9db-3f4f9de57a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:07.025858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead9684-5444-4f3f-a9db-3f4f9de57a89 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:07.026311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead9684-5444-4f3f-a9db-3f4f9de57a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:07.027925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead9684-5444-4f3f-a9db-3f4f9de57a89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:07.051087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead9684-5444-4f3f-a9db-3f4f9de57a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5ead9684-5444-4f3f-a9db-3f4f9de57a89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:07.059379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:07.060312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:07.061100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:07.069191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 118/228] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:55:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:07.077095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead9684-5444-4f3f-a9db-3f4f9de57a89 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:07.097609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ac42a-78e2-4b02-8fb3-e606294b912a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:07.106270 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:07.136431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:07.139917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e02745-8c99-4bdd-b3dd-199df96315bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:07.141205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e02745-8c99-4bdd-b3dd-199df96315bf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:07.142041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e02745-8c99-4bdd-b3dd-199df96315bf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:07.142488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e02745-8c99-4bdd-b3dd-199df96315bf None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:07.144296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e02745-8c99-4bdd-b3dd-199df96315bf None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:07.147128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e02745-8c99-4bdd-b3dd-199df96315bf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:07.150427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 111/229] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:06 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:07.156845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e02745-8c99-4bdd-b3dd-199df96315bf None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:07.289755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead9684-5444-4f3f-a9db-3f4f9de57a89 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:07.351610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e02745-8c99-4bdd-b3dd-199df96315bf None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:07.354601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64762f1f-7fe9-43e8-a4fa-f6d86905e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:07.355279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64762f1f-7fe9-43e8-a4fa-f6d86905e611 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:07.355637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64762f1f-7fe9-43e8-a4fa-f6d86905e611 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:07.355950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64762f1f-7fe9-43e8-a4fa-f6d86905e611 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:07.357575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64762f1f-7fe9-43e8-a4fa-f6d86905e611 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:07.357896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64762f1f-7fe9-43e8-a4fa-f6d86905e611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:07.359304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64762f1f-7fe9-43e8-a4fa-f6d86905e611 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:07.375891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 119/230] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:07.382957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64762f1f-7fe9-43e8-a4fa-f6d86905e611 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:07.413868 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95866a7-ae63-4f5d-95eb-a0dd2ef6d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:07.415121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95866a7-ae63-4f5d-95eb-a0dd2ef6d14b None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:07.415618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95866a7-ae63-4f5d-95eb-a0dd2ef6d14b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:07.416136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95866a7-ae63-4f5d-95eb-a0dd2ef6d14b None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379/users/36bee41bd5884f74beaf36f258561cde/roles/478978f29ae748188de8d1a31490bb00` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:07.418564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95866a7-ae63-4f5d-95eb-a0dd2ef6d14b None admin] RBAC: Authorizing `identity:create_grant(project_id=a39345b421b846488684793b6a430379, user_id=36bee41bd5884f74beaf36f258561cde, role_id=478978f29ae748188de8d1a31490bb00)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:07.420255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95866a7-ae63-4f5d-95eb-a0dd2ef6d14b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:07.479117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:07.495082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64762f1f-7fe9-43e8-a4fa-f6d86905e611 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:07.530829 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2f894-e88f-47a1-ad5d-a80bb588222b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:07.531721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2f894-e88f-47a1-ad5d-a80bb588222b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:07.532126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2f894-e88f-47a1-ad5d-a80bb588222b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:07.535911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2f894-e88f-47a1-ad5d-a80bb588222b None admin] PATH_INFO: `/v3/users/36bee41bd5884f74beaf36f258561cde` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:07.535911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2f894-e88f-47a1-ad5d-a80bb588222b None admin] RBAC: Authorizing `identity:get_user(user_id=36bee41bd5884f74beaf36f258561cde)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:07.535911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2f894-e88f-47a1-ad5d-a80bb588222b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:07.537286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 120/231] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:07 2022] GET /identity/v3/users/36bee41bd5884f74beaf36f258561cde => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:07.542938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 112/232] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:55:07 2022] PUT /identity/v3/projects/a39345b421b846488684793b6a430379/users/36bee41bd5884f74beaf36f258561cde/roles/478978f29ae748188de8d1a31490bb00 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:07.546917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2f894-e88f-47a1-ad5d-a80bb588222b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:07.669615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2f894-e88f-47a1-ad5d-a80bb588222b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:07.725515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d06ddd-d93f-49bd-b932-6ef221ff8dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:07.726420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06ddd-d93f-49bd-b932-6ef221ff8dfd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:07.726708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06ddd-d93f-49bd-b932-6ef221ff8dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:07.726988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06ddd-d93f-49bd-b932-6ef221ff8dfd None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:07.728612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d06ddd-d93f-49bd-b932-6ef221ff8dfd None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:07.730103 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d06ddd-d93f-49bd-b932-6ef221ff8dfd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:07.732096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 121/233] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:07 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:07.738121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95866a7-ae63-4f5d-95eb-a0dd2ef6d14b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:07.785559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:07.857557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95866a7-ae63-4f5d-95eb-a0dd2ef6d14b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:07.893172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d0cd5-cd8c-479f-b651-c580b83f48c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:07.894072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0cd5-cd8c-479f-b651-c580b83f48c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:07.894362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0cd5-cd8c-479f-b651-c580b83f48c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:07.894640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0cd5-cd8c-479f-b651-c580b83f48c1 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379/users/36bee41bd5884f74beaf36f258561cde/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:07.896816 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d0cd5-cd8c-479f-b651-c580b83f48c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39345b421b846488684793b6a430379, user_id=36bee41bd5884f74beaf36f258561cde, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:07.898293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d0cd5-cd8c-479f-b651-c580b83f48c1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:08.000822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 113/234] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:55:07 2022] PUT /identity/v3/projects/a39345b421b846488684793b6a430379/users/36bee41bd5884f74beaf36f258561cde/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:08.170408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f00f4-783f-4bc6-ad05-35d9fffc202a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:08.170784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f00f4-783f-4bc6-ad05-35d9fffc202a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:08.170958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f00f4-783f-4bc6-ad05-35d9fffc202a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:08.172380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 122/235] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:08.178498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680474f5-80a0-4926-b2d3-b63a7876a06b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:08.178816 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680474f5-80a0-4926-b2d3-b63a7876a06b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:08.179104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680474f5-80a0-4926-b2d3-b63a7876a06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:08.205263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-680474f5-80a0-4926-b2d3-b63a7876a06b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:08.206573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-680474f5-80a0-4926-b2d3-b63a7876a06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:08.292928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 114/236] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:08.317145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f00f4-783f-4bc6-ad05-35d9fffc202a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:08.345398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:08.437111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f00f4-783f-4bc6-ad05-35d9fffc202a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:08.478971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65651c4f-d4a7-498c-b244-54ca3c23e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:08.479772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65651c4f-d4a7-498c-b244-54ca3c23e694 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:08.480456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65651c4f-d4a7-498c-b244-54ca3c23e694 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:08.480456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65651c4f-d4a7-498c-b244-54ca3c23e694 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:08.494584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65651c4f-d4a7-498c-b244-54ca3c23e694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:08.497007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f739828-7294-4920-8ab1-5402a0a6dd25 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:08.497427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f739828-7294-4920-8ab1-5402a0a6dd25 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:08.497590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f739828-7294-4920-8ab1-5402a0a6dd25 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:08.499098 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 115/237] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-65651c4f-d4a7-498c-b244-54ca3c23e694 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:08.506958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:08.507855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:08.508667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:08.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba04e8-d163-4161-9d70-116e2ac0dc39 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:08.509906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba04e8-d163-4161-9d70-116e2ac0dc39 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:08.515897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba04e8-d163-4161-9d70-116e2ac0dc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:08.516439 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 123/238] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:08.528050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65651c4f-d4a7-498c-b244-54ca3c23e694 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:08.541070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-faba04e8-d163-4161-9d70-116e2ac0dc39 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:08.542264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-faba04e8-d163-4161-9d70-116e2ac0dc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:08.592261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:08.669917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 116/239] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:08.672895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:08.692094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65651c4f-d4a7-498c-b244-54ca3c23e694 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:08.712937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba04e8-d163-4161-9d70-116e2ac0dc39 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:08.777830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692487-0755-464f-89d9-0400e050bb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:08.778516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692487-0755-464f-89d9-0400e050bb90 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:08.778796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692487-0755-464f-89d9-0400e050bb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:08.779074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35692487-0755-464f-89d9-0400e050bb90 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:08.779837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35692487-0755-464f-89d9-0400e050bb90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:08.780181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35692487-0755-464f-89d9-0400e050bb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:08.781570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35692487-0755-464f-89d9-0400e050bb90 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:08.804730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 124/240] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:08.812874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692487-0755-464f-89d9-0400e050bb90 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:08.825004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba04e8-d163-4161-9d70-116e2ac0dc39 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:08.866863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a839bb1-4667-4850-82b3-62abe2057494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:08.867624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a839bb1-4667-4850-82b3-62abe2057494 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:08.867930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a839bb1-4667-4850-82b3-62abe2057494 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:08.868348 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a839bb1-4667-4850-82b3-62abe2057494 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:08.869561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a839bb1-4667-4850-82b3-62abe2057494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:08.871383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a839bb1-4667-4850-82b3-62abe2057494 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:08.873378 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 117/241] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:08.878769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a839bb1-4667-4850-82b3-62abe2057494 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:08.923738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:08.996563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a839bb1-4667-4850-82b3-62abe2057494 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:09.047796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35692487-0755-464f-89d9-0400e050bb90 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:09.059305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cae30-78ca-4b9f-a105-cb8d12961158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:09.060027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cae30-78ca-4b9f-a105-cb8d12961158 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:09.060317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cae30-78ca-4b9f-a105-cb8d12961158 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:09.060602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cae30-78ca-4b9f-a105-cb8d12961158 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:09.061438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cae30-78ca-4b9f-a105-cb8d12961158 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:09.063004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cae30-78ca-4b9f-a105-cb8d12961158 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:09.082849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e728a-b41b-405a-8c9e-07c833b280e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:09.084468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e728a-b41b-405a-8c9e-07c833b280e6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:09.084888 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e728a-b41b-405a-8c9e-07c833b280e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:09.087684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e728a-b41b-405a-8c9e-07c833b280e6 None admin] PATH_INFO: `/v3/users/0155a9e6313e48719f13e8ecb5db3ab3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:09.099729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e728a-b41b-405a-8c9e-07c833b280e6 None admin] RBAC: Authorizing `identity:get_user(user_id=0155a9e6313e48719f13e8ecb5db3ab3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:09.101246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e728a-b41b-405a-8c9e-07c833b280e6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:09.103167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 125/242] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:08 2022] GET /identity/v3/users/0155a9e6313e48719f13e8ecb5db3ab3 => generated 297 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:09.108431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e728a-b41b-405a-8c9e-07c833b280e6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:09.111069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:09.168854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 118/243] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:55:08 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:55:09.213395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e728a-b41b-405a-8c9e-07c833b280e6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:09.249696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032bd52-c38b-44c4-984f-b2a2b86a1a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:09.250352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032bd52-c38b-44c4-984f-b2a2b86a1a15 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:09.250636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032bd52-c38b-44c4-984f-b2a2b86a1a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:09.250914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032bd52-c38b-44c4-984f-b2a2b86a1a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:09.323335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032bd52-c38b-44c4-984f-b2a2b86a1a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:09.324825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032bd52-c38b-44c4-984f-b2a2b86a1a15 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:09.326786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:09.431532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 126/244] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 11:55:09.437352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cae30-78ca-4b9f-a105-cb8d12961158 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:09.524698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:09.546171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cae30-78ca-4b9f-a105-cb8d12961158 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:09.586720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6830-4d5d-41ff-822c-a48ba1fe5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:09.587606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6830-4d5d-41ff-822c-a48ba1fe5c80 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:09.587913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6830-4d5d-41ff-822c-a48ba1fe5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:09.588199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6830-4d5d-41ff-822c-a48ba1fe5c80 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:09.589421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6830-4d5d-41ff-822c-a48ba1fe5c80 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:09.590894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6830-4d5d-41ff-822c-a48ba1fe5c80 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:09.596090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 119/245] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:09 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:09.598698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032bd52-c38b-44c4-984f-b2a2b86a1a15 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:09.604275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50463f-fb62-45eb-9417-d79f69742382 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:09.604791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50463f-fb62-45eb-9417-d79f69742382 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:09.605247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50463f-fb62-45eb-9417-d79f69742382 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:09.606818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 120/246] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:55:09.612121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9f3b4-55e9-4c4d-a778-f4078eb968b6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:09.612617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9f3b4-55e9-4c4d-a778-f4078eb968b6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:09.613088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9f3b4-55e9-4c4d-a778-f4078eb968b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:09.633192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b6e9f3b4-55e9-4c4d-a778-f4078eb968b6 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:09.634659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b6e9f3b4-55e9-4c4d-a778-f4078eb968b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:09.706118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032bd52-c38b-44c4-984f-b2a2b86a1a15 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:09.707566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:09.712049 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 121/247] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:09.744033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9f3b4-55e9-4c4d-a778-f4078eb968b6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:09.746591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519ac6c-eecf-4588-9dba-74855bc67c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:09.747252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519ac6c-eecf-4588-9dba-74855bc67c70 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:09.747535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519ac6c-eecf-4588-9dba-74855bc67c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:09.747810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519ac6c-eecf-4588-9dba-74855bc67c70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:09.748876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519ac6c-eecf-4588-9dba-74855bc67c70 None admin] RBAC: Adding query filter params (role.id=57d52c1b0a1443818028148b95eb44f6, scope.project.id=a39345b421b846488684793b6a430379, user.id=0155a9e6313e48719f13e8ecb5db3ab3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:09.748985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519ac6c-eecf-4588-9dba-74855bc67c70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:09.751580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519ac6c-eecf-4588-9dba-74855bc67c70 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:09.756802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 127/248] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:09 2022] GET /identity/v3/role_assignments?user.id=0155a9e6313e48719f13e8ecb5db3ab3&scope.project.id=a39345b421b846488684793b6a430379&role.id=57d52c1b0a1443818028148b95eb44f6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:09.845494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:09.867562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9f3b4-55e9-4c4d-a778-f4078eb968b6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:09.906778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3d74-6511-4d60-9aff-0a4820aa787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:09.907640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3d74-6511-4d60-9aff-0a4820aa787d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:09.907953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3d74-6511-4d60-9aff-0a4820aa787d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:09.908230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3d74-6511-4d60-9aff-0a4820aa787d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:09.920277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca3d74-6511-4d60-9aff-0a4820aa787d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-bdca3d74-6511-4d60-9aff-0a4820aa787d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:09.928969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:09.929910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:09.930683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 122/249] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:09.938230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519ac6c-eecf-4588-9dba-74855bc67c70 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:10.047036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05405b-e905-4c8e-b7a3-fdded4629596 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:10.047641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05405b-e905-4c8e-b7a3-fdded4629596 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:10.048173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05405b-e905-4c8e-b7a3-fdded4629596 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:10.049771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 123/250] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:10.055813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af86bb-4588-485a-af13-b4b94e6cc788 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:10.056393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af86bb-4588-485a-af13-b4b94e6cc788 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:10.056888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af86bb-4588-485a-af13-b4b94e6cc788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:10.064855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519ac6c-eecf-4588-9dba-74855bc67c70 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:10.078549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-71af86bb-4588-485a-af13-b4b94e6cc788 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:10.080145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-71af86bb-4588-485a-af13-b4b94e6cc788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:10.106155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492ae20-ca42-4b9f-8e63-73a9d6a48999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:10.106840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492ae20-ca42-4b9f-8e63-73a9d6a48999 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:10.107395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492ae20-ca42-4b9f-8e63-73a9d6a48999 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:10.107678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492ae20-ca42-4b9f-8e63-73a9d6a48999 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:10.108476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492ae20-ca42-4b9f-8e63-73a9d6a48999 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:10.108784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492ae20-ca42-4b9f-8e63-73a9d6a48999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:10.110171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492ae20-ca42-4b9f-8e63-73a9d6a48999 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:10.124132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 128/251] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:10.127835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492ae20-ca42-4b9f-8e63-73a9d6a48999 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:10.166028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:10.169933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 124/252] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:10.207524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af86bb-4588-485a-af13-b4b94e6cc788 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:10.304916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492ae20-ca42-4b9f-8e63-73a9d6a48999 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:10.355127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:10.398388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d05d6-5a44-40eb-92d3-ef559dc7f914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:10.399283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d05d6-5a44-40eb-92d3-ef559dc7f914 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:10.399572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d05d6-5a44-40eb-92d3-ef559dc7f914 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:10.399851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d05d6-5a44-40eb-92d3-ef559dc7f914 None admin] PATH_INFO: `/v3/users/9a63582f2ffd44b292d438e72d3ab762` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:10.401876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d05d6-5a44-40eb-92d3-ef559dc7f914 None admin] RBAC: Authorizing `identity:get_user(user_id=9a63582f2ffd44b292d438e72d3ab762)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:10.403343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d05d6-5a44-40eb-92d3-ef559dc7f914 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:10.405054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 129/253] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:10 2022] GET /identity/v3/users/9a63582f2ffd44b292d438e72d3ab762 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:10.413272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d05d6-5a44-40eb-92d3-ef559dc7f914 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:10.445519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af86bb-4588-485a-af13-b4b94e6cc788 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:10.526843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78082d7b-24ac-4412-86e1-e2603a1e1d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:10.527690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78082d7b-24ac-4412-86e1-e2603a1e1d86 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:10.528004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78082d7b-24ac-4412-86e1-e2603a1e1d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:10.528287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78082d7b-24ac-4412-86e1-e2603a1e1d86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:10.556024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78082d7b-24ac-4412-86e1-e2603a1e1d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-78082d7b-24ac-4412-86e1-e2603a1e1d86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:10.571280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:10.572217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:10.572996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 125/254] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:10.578314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78082d7b-24ac-4412-86e1-e2603a1e1d86 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:10.600497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:10.607528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d05d6-5a44-40eb-92d3-ef559dc7f914 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:10.650070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752819a-48a2-4e15-a1d8-2146268e38bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:10.650944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752819a-48a2-4e15-a1d8-2146268e38bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:10.651234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752819a-48a2-4e15-a1d8-2146268e38bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:10.653738 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752819a-48a2-4e15-a1d8-2146268e38bc None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:10.655931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752819a-48a2-4e15-a1d8-2146268e38bc None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:10.657394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752819a-48a2-4e15-a1d8-2146268e38bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:10.659302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 130/255] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:10 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:10.669900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752819a-48a2-4e15-a1d8-2146268e38bc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:10.790543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752819a-48a2-4e15-a1d8-2146268e38bc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:10.877042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ed2a7-c593-4f5a-8d7a-23e52ab18bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:10.877971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed2a7-c593-4f5a-8d7a-23e52ab18bb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:10.878361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed2a7-c593-4f5a-8d7a-23e52ab18bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:10.878639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ed2a7-c593-4f5a-8d7a-23e52ab18bb1 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379/users/9a63582f2ffd44b292d438e72d3ab762/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:10.886431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ed2a7-c593-4f5a-8d7a-23e52ab18bb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39345b421b846488684793b6a430379, user_id=9a63582f2ffd44b292d438e72d3ab762, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:10.886431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ed2a7-c593-4f5a-8d7a-23e52ab18bb1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:10.886637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78082d7b-24ac-4412-86e1-e2603a1e1d86 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:10.954147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:10.965533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3751a1a-2e1c-4ce8-bbfe-4dbf869d7173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:10.966488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3751a1a-2e1c-4ce8-bbfe-4dbf869d7173 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:10.966932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3751a1a-2e1c-4ce8-bbfe-4dbf869d7173 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:10.967373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3751a1a-2e1c-4ce8-bbfe-4dbf869d7173 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:10.968417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3751a1a-2e1c-4ce8-bbfe-4dbf869d7173 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:10.968868 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3751a1a-2e1c-4ce8-bbfe-4dbf869d7173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:10.970627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3751a1a-2e1c-4ce8-bbfe-4dbf869d7173 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:10.981744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 126/256] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:10.983575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dfe46-6751-492e-831b-c80458180ea8 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:10.984423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dfe46-6751-492e-831b-c80458180ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:10.984830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dfe46-6751-492e-831b-c80458180ea8 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:10.990530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 127/257] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:10.999275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 131/258] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:55:10 2022] PUT /identity/v3/projects/a39345b421b846488684793b6a430379/users/9a63582f2ffd44b292d438e72d3ab762/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:11.000012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dfe46-6751-492e-831b-c80458180ea8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:11.001795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd900-2e4a-4844-9947-6fe711100539 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:11.002258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd900-2e4a-4844-9947-6fe711100539 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:11.002668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd900-2e4a-4844-9947-6fe711100539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:11.045559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-633dd900-2e4a-4844-9947-6fe711100539 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:11.047110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-633dd900-2e4a-4844-9947-6fe711100539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:11.100622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:11.278849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 132/259] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:11.303634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dfe46-6751-492e-831b-c80458180ea8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:11.345293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dd900-2e4a-4844-9947-6fe711100539 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:11.387059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04315cd5-c2de-452c-8663-7bbb8dbad9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:11.388068 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04315cd5-c2de-452c-8663-7bbb8dbad9ff None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:11.389062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04315cd5-c2de-452c-8663-7bbb8dbad9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:11.389611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04315cd5-c2de-452c-8663-7bbb8dbad9ff None admin] PATH_INFO: `/v3/users/36bee41bd5884f74beaf36f258561cde` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:11.391461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04315cd5-c2de-452c-8663-7bbb8dbad9ff None admin] RBAC: Authorizing `identity:get_user(user_id=36bee41bd5884f74beaf36f258561cde)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:11.392822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04315cd5-c2de-452c-8663-7bbb8dbad9ff None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:11.394513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 128/260] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:10 2022] GET /identity/v3/users/36bee41bd5884f74beaf36f258561cde => generated 283 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:11.411913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04315cd5-c2de-452c-8663-7bbb8dbad9ff None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:11.524643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:11.637647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dd900-2e4a-4844-9947-6fe711100539 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:11.638590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04315cd5-c2de-452c-8663-7bbb8dbad9ff None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:11.715148 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67924d78-cc2a-4b65-81db-58b9d45bbc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:11.716004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67924d78-cc2a-4b65-81db-58b9d45bbc8d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:11.716289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67924d78-cc2a-4b65-81db-58b9d45bbc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:11.716563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67924d78-cc2a-4b65-81db-58b9d45bbc8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:11.741273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67924d78-cc2a-4b65-81db-58b9d45bbc8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-67924d78-cc2a-4b65-81db-58b9d45bbc8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:11.750086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:11.751002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:11.751862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 133/261] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:55:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:11.758063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67924d78-cc2a-4b65-81db-58b9d45bbc8d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:11.769163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28346e5-17e7-420a-8dba-76518db87bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:11.770117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28346e5-17e7-420a-8dba-76518db87bcd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:11.770607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28346e5-17e7-420a-8dba-76518db87bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:11.771171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28346e5-17e7-420a-8dba-76518db87bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:11.785797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:11.885197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67924d78-cc2a-4b65-81db-58b9d45bbc8d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:11.931304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17d332-a563-4d14-a9ae-6cbb34b1e133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:11.932023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17d332-a563-4d14-a9ae-6cbb34b1e133 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:11.932310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17d332-a563-4d14-a9ae-6cbb34b1e133 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:11.932587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17d332-a563-4d14-a9ae-6cbb34b1e133 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:11.933810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17d332-a563-4d14-a9ae-6cbb34b1e133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:11.934128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17d332-a563-4d14-a9ae-6cbb34b1e133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:11.935748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17d332-a563-4d14-a9ae-6cbb34b1e133 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:11.955397 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 134/262] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:11.961292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17d332-a563-4d14-a9ae-6cbb34b1e133 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:11.962579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28346e5-17e7-420a-8dba-76518db87bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:11.964328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28346e5-17e7-420a-8dba-76518db87bcd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:12.069897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:12.105677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:12.122009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 129/263] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:12.129404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28346e5-17e7-420a-8dba-76518db87bcd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:12.140370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17d332-a563-4d14-a9ae-6cbb34b1e133 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:12.197355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b81ba8-b9f4-4492-a705-e3a08844d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:12.198515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b81ba8-b9f4-4492-a705-e3a08844d33a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:12.198797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b81ba8-b9f4-4492-a705-e3a08844d33a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:12.199115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b81ba8-b9f4-4492-a705-e3a08844d33a None admin] PATH_INFO: `/v3/users/36bee41bd5884f74beaf36f258561cde` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:12.207433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b81ba8-b9f4-4492-a705-e3a08844d33a None admin] RBAC: Authorizing `identity:get_user(user_id=36bee41bd5884f74beaf36f258561cde)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:12.210076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b81ba8-b9f4-4492-a705-e3a08844d33a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:12.211990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 135/264] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:11 2022] GET /identity/v3/users/36bee41bd5884f74beaf36f258561cde => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:12.221392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b81ba8-b9f4-4492-a705-e3a08844d33a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:12.370262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28346e5-17e7-420a-8dba-76518db87bcd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:12.408036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b81ba8-b9f4-4492-a705-e3a08844d33a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:12.456967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5603c-99cf-44dc-b181-07042d57b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:12.459245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5603c-99cf-44dc-b181-07042d57b4fd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:12.459537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5603c-99cf-44dc-b181-07042d57b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:12.459812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5603c-99cf-44dc-b181-07042d57b4fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:12.463286 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551ee1-643e-475b-96a9-52a5f21aa899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:12.464193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551ee1-643e-475b-96a9-52a5f21aa899 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:12.464475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551ee1-643e-475b-96a9-52a5f21aa899 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:12.464751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551ee1-643e-475b-96a9-52a5f21aa899 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:12.466020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551ee1-643e-475b-96a9-52a5f21aa899 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:12.467478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93551ee1-643e-475b-96a9-52a5f21aa899 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:12.469214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 130/265] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:12 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:12.479481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551ee1-643e-475b-96a9-52a5f21aa899 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:12.530255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:12.581577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:12.639778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5603c-99cf-44dc-b181-07042d57b4fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:12.641207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5603c-99cf-44dc-b181-07042d57b4fd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:12.727907 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551ee1-643e-475b-96a9-52a5f21aa899 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:12.788346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 136/266] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:12.789713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61e98-f4d8-4e24-8d12-dd7bfaf5134a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:12.790001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61e98-f4d8-4e24-8d12-dd7bfaf5134a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:12.790276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61e98-f4d8-4e24-8d12-dd7bfaf5134a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:12.791734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 137/267] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:12.792338 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61e98-f4d8-4e24-8d12-dd7bfaf5134a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:12.799522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5471828-2a85-4e52-b41a-a0030e08835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:12.800218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5471828-2a85-4e52-b41a-a0030e08835f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:12.800498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5471828-2a85-4e52-b41a-a0030e08835f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:12.800771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5471828-2a85-4e52-b41a-a0030e08835f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:12.801615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5471828-2a85-4e52-b41a-a0030e08835f None admin] RBAC: Adding query filter params (role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=a39345b421b846488684793b6a430379, user.id=36bee41bd5884f74beaf36f258561cde) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:12.802007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5471828-2a85-4e52-b41a-a0030e08835f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:12.803473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5471828-2a85-4e52-b41a-a0030e08835f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:12.811130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 131/268] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:12 2022] GET /identity/v3/role_assignments?user.id=36bee41bd5884f74beaf36f258561cde&scope.project.id=a39345b421b846488684793b6a430379&role.id=478978f29ae748188de8d1a31490bb00 => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:12.812437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674e41f-60e4-4ef2-9836-3b175c6c24fd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:12.812722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674e41f-60e4-4ef2-9836-3b175c6c24fd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:12.812999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674e41f-60e4-4ef2-9836-3b175c6c24fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:12.844054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4674e41f-60e4-4ef2-9836-3b175c6c24fd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:12.845281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4674e41f-60e4-4ef2-9836-3b175c6c24fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:12.872282 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:12.919738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 132/269] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:12.921112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7d5cb-c605-4dbc-be0e-c2f8931ceca9 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:12.928223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7d5cb-c605-4dbc-be0e-c2f8931ceca9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:12.928562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7d5cb-c605-4dbc-be0e-c2f8931ceca9 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:12.930144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 133/270] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:12.933799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61e98-f4d8-4e24-8d12-dd7bfaf5134a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:12.941626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7cf31-0c22-4ee7-99e8-90d75ae157e3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:12.941948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7cf31-0c22-4ee7-99e8-90d75ae157e3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:12.942186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7cf31-0c22-4ee7-99e8-90d75ae157e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:12.971779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b93d-7ad9-428f-8bf9-605d3bf42768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:12.972693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b93d-7ad9-428f-8bf9-605d3bf42768 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:12.972981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b93d-7ad9-428f-8bf9-605d3bf42768 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:12.973260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b93d-7ad9-428f-8bf9-605d3bf42768 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:12.974743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63b93d-7ad9-428f-8bf9-605d3bf42768 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:12.976257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63b93d-7ad9-428f-8bf9-605d3bf42768 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:12.977051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-02f7cf31-0c22-4ee7-99e8-90d75ae157e3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:12.978570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-02f7cf31-0c22-4ee7-99e8-90d75ae157e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:12.978701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 138/271] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:12 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:12.979354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b93d-7ad9-428f-8bf9-605d3bf42768 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.009488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:13.090472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b93d-7ad9-428f-8bf9-605d3bf42768 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:13.113731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:13.138423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 134/272] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:13.139361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7cf31-0c22-4ee7-99e8-90d75ae157e3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.141522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2183d1-063f-4ff6-9c89-47047e203381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:13.142527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2183d1-063f-4ff6-9c89-47047e203381 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.142979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2183d1-063f-4ff6-9c89-47047e203381 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.144026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2183d1-063f-4ff6-9c89-47047e203381 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.156012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2183d1-063f-4ff6-9c89-47047e203381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1d2183d1-063f-4ff6-9c89-47047e203381 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:13.163939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:13.164813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:13.165586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 139/273] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:13.166717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc41bb-4678-474a-a15f-2753a45bcfed None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.166820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc41bb-4678-474a-a15f-2753a45bcfed None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.171972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc41bb-4678-474a-a15f-2753a45bcfed None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.171972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 140/274] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:13.171972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc41bb-4678-474a-a15f-2753a45bcfed None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.276296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7cf31-0c22-4ee7-99e8-90d75ae157e3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:13.287302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc41bb-4678-474a-a15f-2753a45bcfed None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:13.313203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b210e-457e-4913-b761-0599cd15be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:13.313857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b210e-457e-4913-b761-0599cd15be40 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.314138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b210e-457e-4913-b761-0599cd15be40 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.314407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b210e-457e-4913-b761-0599cd15be40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.315309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b210e-457e-4913-b761-0599cd15be40 None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=a39345b421b846488684793b6a430379, user.id=36bee41bd5884f74beaf36f258561cde) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:13.315629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b210e-457e-4913-b761-0599cd15be40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:13.317095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b210e-457e-4913-b761-0599cd15be40 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:13.322740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15657b27-d18b-4fae-928d-0c901cddafb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:13.323193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 135/275] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:13 2022] GET /identity/v3/role_assignments?user.id=36bee41bd5884f74beaf36f258561cde&scope.project.id=a39345b421b846488684793b6a430379&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:13.323804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15657b27-d18b-4fae-928d-0c901cddafb7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.324140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15657b27-d18b-4fae-928d-0c901cddafb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.324477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15657b27-d18b-4fae-928d-0c901cddafb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.325236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15657b27-d18b-4fae-928d-0c901cddafb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:13.325546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15657b27-d18b-4fae-928d-0c901cddafb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:13.327075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15657b27-d18b-4fae-928d-0c901cddafb7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:13.339005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850dda-92c5-4eae-a447-c5be2fc261a8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.339005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850dda-92c5-4eae-a447-c5be2fc261a8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.339005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850dda-92c5-4eae-a447-c5be2fc261a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.345667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 141/276] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:13.346784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15657b27-d18b-4fae-928d-0c901cddafb7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.360016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8f850dda-92c5-4eae-a447-c5be2fc261a8 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:13.361387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8f850dda-92c5-4eae-a447-c5be2fc261a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:13.370432 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:13.396512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:13.439594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 136/277] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:13.441060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f850dda-92c5-4eae-a447-c5be2fc261a8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.479931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15657b27-d18b-4fae-928d-0c901cddafb7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:13.521382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efcc03-ac87-4a66-9075-e8e52157c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:13.522307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efcc03-ac87-4a66-9075-e8e52157c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.522736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efcc03-ac87-4a66-9075-e8e52157c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.523078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efcc03-ac87-4a66-9075-e8e52157c8c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.524531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efcc03-ac87-4a66-9075-e8e52157c8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:13.527538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efcc03-ac87-4a66-9075-e8e52157c8c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:13.528379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 142/278] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:13.529862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efcc03-ac87-4a66-9075-e8e52157c8c7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.569077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f850dda-92c5-4eae-a447-c5be2fc261a8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:13.611364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e4a11-6a35-416c-a5d5-6e432b8a854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:13.613024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4a11-6a35-416c-a5d5-6e432b8a854e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.613551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4a11-6a35-416c-a5d5-6e432b8a854e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.614812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e4a11-6a35-416c-a5d5-6e432b8a854e None admin] PATH_INFO: `/v3/users/0155a9e6313e48719f13e8ecb5db3ab3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.616485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e4a11-6a35-416c-a5d5-6e432b8a854e None admin] RBAC: Authorizing `identity:get_user(user_id=0155a9e6313e48719f13e8ecb5db3ab3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:13.618846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e4a11-6a35-416c-a5d5-6e432b8a854e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:13.621411 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 137/279] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:13 2022] GET /identity/v3/users/0155a9e6313e48719f13e8ecb5db3ab3 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:13.622653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e4a11-6a35-416c-a5d5-6e432b8a854e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.639115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:13.655686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efcc03-ac87-4a66-9075-e8e52157c8c7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:13.658438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:13.698338 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89f9a2-ec5a-46ea-a894-c3811426f883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:13.699311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89f9a2-ec5a-46ea-a894-c3811426f883 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.699311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89f9a2-ec5a-46ea-a894-c3811426f883 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.699589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89f9a2-ec5a-46ea-a894-c3811426f883 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.710363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89f9a2-ec5a-46ea-a894-c3811426f883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ba89f9a2-ec5a-46ea-a894-c3811426f883 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:13.718438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:13.719482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:13.720498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:13.721531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 143/280] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:13.722329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89f9a2-ec5a-46ea-a894-c3811426f883 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.738597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e4a11-6a35-416c-a5d5-6e432b8a854e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:13.777713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dffe7-3355-419d-bed8-6222e7b5bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:13.778395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dffe7-3355-419d-bed8-6222e7b5bb0e None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.778653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dffe7-3355-419d-bed8-6222e7b5bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.778929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dffe7-3355-419d-bed8-6222e7b5bb0e None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.779641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dffe7-3355-419d-bed8-6222e7b5bb0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:13.781117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dffe7-3355-419d-bed8-6222e7b5bb0e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:13.826317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89f9a2-ec5a-46ea-a894-c3811426f883 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:13.859555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee1ff-4212-4d9a-b5c4-76af70814403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:13.860481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee1ff-4212-4d9a-b5c4-76af70814403 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:13.860762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee1ff-4212-4d9a-b5c4-76af70814403 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:13.861031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee1ff-4212-4d9a-b5c4-76af70814403 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:13.862230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee1ff-4212-4d9a-b5c4-76af70814403 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:13.863724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee1ff-4212-4d9a-b5c4-76af70814403 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:13.865510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 144/281] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:13 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:13.866265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee1ff-4212-4d9a-b5c4-76af70814403 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.891910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 138/282] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:55:13 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:55:13.891910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dffe7-3355-419d-bed8-6222e7b5bb0e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:13.909088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:13.985275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:14.023283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee1ff-4212-4d9a-b5c4-76af70814403 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:14.027024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dffe7-3355-419d-bed8-6222e7b5bb0e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:14.068149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73001bf8-5ade-4041-a92e-ec8bc9d15d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:14.068371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96551f-2c1c-4bc8-83ab-46e64b329a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:14.069047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73001bf8-5ade-4041-a92e-ec8bc9d15d25 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:14.069294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96551f-2c1c-4bc8-83ab-46e64b329a2b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:14.069382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73001bf8-5ade-4041-a92e-ec8bc9d15d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:14.069592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73001bf8-5ade-4041-a92e-ec8bc9d15d25 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379/users/0155a9e6313e48719f13e8ecb5db3ab3/roles/57d52c1b0a1443818028148b95eb44f6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:14.069700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96551f-2c1c-4bc8-83ab-46e64b329a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:14.069987 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96551f-2c1c-4bc8-83ab-46e64b329a2b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:14.070843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96551f-2c1c-4bc8-83ab-46e64b329a2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:14.071745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96551f-2c1c-4bc8-83ab-46e64b329a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:14.072490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73001bf8-5ade-4041-a92e-ec8bc9d15d25 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39345b421b846488684793b6a430379, user_id=0155a9e6313e48719f13e8ecb5db3ab3, role_id=57d52c1b0a1443818028148b95eb44f6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:14.072660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96551f-2c1c-4bc8-83ab-46e64b329a2b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:14.073951 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73001bf8-5ade-4041-a92e-ec8bc9d15d25 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:14.082892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 145/283] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:14.088588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96551f-2c1c-4bc8-83ab-46e64b329a2b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:14.143275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 139/284] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:55:13 2022] PUT /identity/v3/projects/a39345b421b846488684793b6a430379/users/0155a9e6313e48719f13e8ecb5db3ab3/roles/57d52c1b0a1443818028148b95eb44f6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:14.144659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3a1cd-868b-4899-910a-ad0a080a567b None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:14.144956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3a1cd-868b-4899-910a-ad0a080a567b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:14.145238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3a1cd-868b-4899-910a-ad0a080a567b None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:14.147551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 140/285] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:14.152825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e97c-690c-4e4a-b454-6e535ab6b31b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:14.154022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e97c-690c-4e4a-b454-6e535ab6b31b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:14.154022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e97c-690c-4e4a-b454-6e535ab6b31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:14.175789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2049e97c-690c-4e4a-b454-6e535ab6b31b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:14.177078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2049e97c-690c-4e4a-b454-6e535ab6b31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:14.195172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:14.205180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96551f-2c1c-4bc8-83ab-46e64b329a2b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:14.262201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0b0b8-496c-4345-8667-c0f3756ce791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:14.263031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0b0b8-496c-4345-8667-c0f3756ce791 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:14.263327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0b0b8-496c-4345-8667-c0f3756ce791 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:14.263600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0b0b8-496c-4345-8667-c0f3756ce791 None admin] PATH_INFO: `/v3/users/a97f628d7b25433a9c191cd08073b4d1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:14.281927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0b0b8-496c-4345-8667-c0f3756ce791 None admin] RBAC: Authorizing `identity:get_user(user_id=a97f628d7b25433a9c191cd08073b4d1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:14.282275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 141/286] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:14.287669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0b0b8-496c-4345-8667-c0f3756ce791 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:14.287669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 146/287] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:14 2022] GET /identity/v3/users/a97f628d7b25433a9c191cd08073b4d1 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:14.292277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049e97c-690c-4e4a-b454-6e535ab6b31b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:14.308135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0b0b8-496c-4345-8667-c0f3756ce791 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:14.374531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:14.445725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049e97c-690c-4e4a-b454-6e535ab6b31b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:14.464887 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0b0b8-496c-4345-8667-c0f3756ce791 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:14.513886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133329a-1805-4f90-bd16-cdb5cc5a8282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:14.514473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133329a-1805-4f90-bd16-cdb5cc5a8282 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:14.514754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133329a-1805-4f90-bd16-cdb5cc5a8282 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:14.515024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133329a-1805-4f90-bd16-cdb5cc5a8282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:14.518229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133329a-1805-4f90-bd16-cdb5cc5a8282 None admin] RBAC: Adding query filter params (role.id=060d4fd81b0744fd9118c205f3961d49, user.id=a97f628d7b25433a9c191cd08073b4d1, scope.system=all) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:14.518547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133329a-1805-4f90-bd16-cdb5cc5a8282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:14.522695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133329a-1805-4f90-bd16-cdb5cc5a8282 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:14.529335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 142/288] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Jun 28 11:55:14 2022] GET /identity/v3/role_assignments?user.id=a97f628d7b25433a9c191cd08073b4d1&scope.system=all&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:14.531509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6be0dc-41d4-44ef-8bba-a510ff2a02e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:14.540074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be0dc-41d4-44ef-8bba-a510ff2a02e4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:14.540074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be0dc-41d4-44ef-8bba-a510ff2a02e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:14.540074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6be0dc-41d4-44ef-8bba-a510ff2a02e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:14.577061 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6be0dc-41d4-44ef-8bba-a510ff2a02e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5a6be0dc-41d4-44ef-8bba-a510ff2a02e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:14.585293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:14.586165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:14.586927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:14.592186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 147/289] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:14.592787 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133329a-1805-4f90-bd16-cdb5cc5a8282 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:14.760518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133329a-1805-4f90-bd16-cdb5cc5a8282 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:14.788318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:14.803768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dcba6-0532-4eee-9255-780bbc3e813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:14.804482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dcba6-0532-4eee-9255-780bbc3e813b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:14.804763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dcba6-0532-4eee-9255-780bbc3e813b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:14.805183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dcba6-0532-4eee-9255-780bbc3e813b None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:14.805781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dcba6-0532-4eee-9255-780bbc3e813b None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:14.806265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dcba6-0532-4eee-9255-780bbc3e813b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:14.807657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dcba6-0532-4eee-9255-780bbc3e813b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:14.816992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 143/290] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:14.824585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6be0dc-41d4-44ef-8bba-a510ff2a02e4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:14.857366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:15.000307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6be0dc-41d4-44ef-8bba-a510ff2a02e4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:15.050023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f633fb-a53b-4cfb-b7b0-e25b817d0986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:15.050838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f633fb-a53b-4cfb-b7b0-e25b817d0986 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:15.051123 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f633fb-a53b-4cfb-b7b0-e25b817d0986 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:15.051399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f633fb-a53b-4cfb-b7b0-e25b817d0986 None admin] PATH_INFO: `/v3/users/9a63582f2ffd44b292d438e72d3ab762` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:15.052710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f633fb-a53b-4cfb-b7b0-e25b817d0986 None admin] RBAC: Authorizing `identity:get_user(user_id=9a63582f2ffd44b292d438e72d3ab762)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:15.054147 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f633fb-a53b-4cfb-b7b0-e25b817d0986 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:15.056152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 148/291] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:14 2022] GET /identity/v3/users/9a63582f2ffd44b292d438e72d3ab762 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:15.061227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dcba6-0532-4eee-9255-780bbc3e813b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:15.193220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dcba6-0532-4eee-9255-780bbc3e813b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:15.243491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6fc9-837a-4e09-ac69-42a08f197b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:15.244498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6fc9-837a-4e09-ac69-42a08f197b38 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:15.244977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6fc9-837a-4e09-ac69-42a08f197b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:15.245467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6fc9-837a-4e09-ac69-42a08f197b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:15.307258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:15.335344 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6fc9-837a-4e09-ac69-42a08f197b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:15.336896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6fc9-837a-4e09-ac69-42a08f197b38 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:15.472837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 144/292] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:15.479136 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f633fb-a53b-4cfb-b7b0-e25b817d0986 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:15.603547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:15.627492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f633fb-a53b-4cfb-b7b0-e25b817d0986 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:15.671598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9987f-e997-4202-ac2e-98c0ea35ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:15.672487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9987f-e997-4202-ac2e-98c0ea35ec25 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:15.672768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9987f-e997-4202-ac2e-98c0ea35ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:15.673041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9987f-e997-4202-ac2e-98c0ea35ec25 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:15.674239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9987f-e997-4202-ac2e-98c0ea35ec25 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:15.675690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9987f-e997-4202-ac2e-98c0ea35ec25 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:15.678377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 149/293] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:15 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:15.684089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6fc9-837a-4e09-ac69-42a08f197b38 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:15.809130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:15.820892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6fc9-837a-4e09-ac69-42a08f197b38 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:15.855087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaca7d4-7f45-4748-b9b6-cf8f0b81bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:15.855680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca7d4-7f45-4748-b9b6-cf8f0b81bd3d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:15.860225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca7d4-7f45-4748-b9b6-cf8f0b81bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:15.860561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca7d4-7f45-4748-b9b6-cf8f0b81bd3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:15.861406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaca7d4-7f45-4748-b9b6-cf8f0b81bd3d None admin] RBAC: Adding query filter params (role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=a39345b421b846488684793b6a430379, user.id=9a63582f2ffd44b292d438e72d3ab762) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:15.861722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaca7d4-7f45-4748-b9b6-cf8f0b81bd3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:15.863160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaca7d4-7f45-4748-b9b6-cf8f0b81bd3d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:15.869990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 145/294] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:15 2022] GET /identity/v3/role_assignments?user.id=9a63582f2ffd44b292d438e72d3ab762&scope.project.id=a39345b421b846488684793b6a430379&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:16.641025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20b0b-a72a-4e32-8812-0d9f50773e93 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:16.641529 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20b0b-a72a-4e32-8812-0d9f50773e93 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:16.641606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20b0b-a72a-4e32-8812-0d9f50773e93 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:16.643240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 150/295] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:16.648526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23664e-e8e3-4375-9061-874a29d5d622 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:16.648817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23664e-e8e3-4375-9061-874a29d5d622 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:16.649095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23664e-e8e3-4375-9061-874a29d5d622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:16.651686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e14e1-4b86-4f72-a507-4f98fe878bda None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:16.652020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e14e1-4b86-4f72-a507-4f98fe878bda None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:16.652303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e14e1-4b86-4f72-a507-4f98fe878bda None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:16.653721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 151/296] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:16.658766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333daf2c-4014-4636-b8f4-4acd646f447e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:16.659052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333daf2c-4014-4636-b8f4-4acd646f447e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:16.659333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333daf2c-4014-4636-b8f4-4acd646f447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:16.671253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9a23664e-e8e3-4375-9061-874a29d5d622 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:16.673082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9a23664e-e8e3-4375-9061-874a29d5d622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:16.676016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-333daf2c-4014-4636-b8f4-4acd646f447e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:16.677874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-333daf2c-4014-4636-b8f4-4acd646f447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:16.747658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 152/297] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:16.748852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc382f-104c-4fa6-83c3-8dd8e18126fc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:16.749144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc382f-104c-4fa6-83c3-8dd8e18126fc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:16.749423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc382f-104c-4fa6-83c3-8dd8e18126fc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:16.750817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 153/298] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:16.756767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590fdc8-e987-49d0-8a53-13783869b3b9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:16.757058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590fdc8-e987-49d0-8a53-13783869b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:16.757343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590fdc8-e987-49d0-8a53-13783869b3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:16.758443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 146/299] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:16.775280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23664e-e8e3-4375-9061-874a29d5d622 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:16.780748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7590fdc8-e987-49d0-8a53-13783869b3b9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:16.782049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7590fdc8-e987-49d0-8a53-13783869b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:16.854261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 154/300] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:16.855381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590fdc8-e987-49d0-8a53-13783869b3b9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:16.864040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:16.874903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:16.898032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23664e-e8e3-4375-9061-874a29d5d622 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:16.932998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac62927-ab35-4688-9326-4a2ff819cdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:16.933798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac62927-ab35-4688-9326-4a2ff819cdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:16.934078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac62927-ab35-4688-9326-4a2ff819cdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:16.934372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac62927-ab35-4688-9326-4a2ff819cdf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:16.944173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac62927-ab35-4688-9326-4a2ff819cdf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-cac62927-ab35-4688-9326-4a2ff819cdf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:16.952230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:16.953516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:16.954649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 147/301] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:16.959457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac62927-ab35-4688-9326-4a2ff819cdf9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:16.967502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590fdc8-e987-49d0-8a53-13783869b3b9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.001849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2ce80-f2f6-4c78-8b37-24df06fd089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.002645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2ce80-f2f6-4c78-8b37-24df06fd089c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.002927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2ce80-f2f6-4c78-8b37-24df06fd089c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.003202 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2ce80-f2f6-4c78-8b37-24df06fd089c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.013280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2ce80-f2f6-4c78-8b37-24df06fd089c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6fa2ce80-f2f6-4c78-8b37-24df06fd089c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:17.020929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:17.021805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:17.022878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 155/302] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:17.023771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc20b7-aad9-4c20-b99e-e906964d5918 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.023771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc20b7-aad9-4c20-b99e-e906964d5918 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.023923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc20b7-aad9-4c20-b99e-e906964d5918 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.025092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 156/303] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:17.025833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc20b7-aad9-4c20-b99e-e906964d5918 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.063241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac62927-ab35-4688-9326-4a2ff819cdf9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.090042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:17.096490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc727ea-37e5-427c-b9b4-52beeb55e3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.097276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc727ea-37e5-427c-b9b4-52beeb55e3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.097561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc727ea-37e5-427c-b9b4-52beeb55e3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.097887 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc727ea-37e5-427c-b9b4-52beeb55e3b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.099666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc727ea-37e5-427c-b9b4-52beeb55e3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:17.101153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc727ea-37e5-427c-b9b4-52beeb55e3b4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:17.102796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 148/304] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:17.104701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc727ea-37e5-427c-b9b4-52beeb55e3b4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.108658 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:17.126309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc20b7-aad9-4c20-b99e-e906964d5918 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.160328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3bb0a-d59b-428e-8dab-6683d462d87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.161016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3bb0a-d59b-428e-8dab-6683d462d87c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.161886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3bb0a-d59b-428e-8dab-6683d462d87c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.162169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3bb0a-d59b-428e-8dab-6683d462d87c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.162927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3bb0a-d59b-428e-8dab-6683d462d87c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:17.163244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3bb0a-d59b-428e-8dab-6683d462d87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:17.164673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3bb0a-d59b-428e-8dab-6683d462d87c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:17.172750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 157/305] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:17.173852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40804c-267b-4b48-9260-d5bc3b745811 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.174140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40804c-267b-4b48-9260-d5bc3b745811 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.174418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40804c-267b-4b48-9260-d5bc3b745811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.190035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3c40804c-267b-4b48-9260-d5bc3b745811 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:17.191234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3c40804c-267b-4b48-9260-d5bc3b745811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:17.208594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc727ea-37e5-427c-b9b4-52beeb55e3b4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.243016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d7ce0-e398-48f0-9436-4fe346e33a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.243680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d7ce0-e398-48f0-9436-4fe346e33a20 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.243986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d7ce0-e398-48f0-9436-4fe346e33a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.244259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d7ce0-e398-48f0-9436-4fe346e33a20 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.245002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d7ce0-e398-48f0-9436-4fe346e33a20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:17.245307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d7ce0-e398-48f0-9436-4fe346e33a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:17.246672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d7ce0-e398-48f0-9436-4fe346e33a20 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:17.254674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 149/306] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:17.258699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 158/307] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:17.259636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40804c-267b-4b48-9260-d5bc3b745811 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.259957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d7ce0-e398-48f0-9436-4fe346e33a20 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.327481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:17.334617 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:17.362728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d7ce0-e398-48f0-9436-4fe346e33a20 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.375205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c40804c-267b-4b48-9260-d5bc3b745811 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.396849 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380033ce-395e-4391-a48e-372f90640491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.397517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380033ce-395e-4391-a48e-372f90640491 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.397798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380033ce-395e-4391-a48e-372f90640491 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.398070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380033ce-395e-4391-a48e-372f90640491 None admin] PATH_INFO: `/v3/groups` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.398759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380033ce-395e-4391-a48e-372f90640491 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:17.400249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380033ce-395e-4391-a48e-372f90640491 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:17.409402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8e9d1-d931-4abd-b93a-d44e1e81c671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.410278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8e9d1-d931-4abd-b93a-d44e1e81c671 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.410577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8e9d1-d931-4abd-b93a-d44e1e81c671 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.410845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8e9d1-d931-4abd-b93a-d44e1e81c671 None admin] PATH_INFO: `/v3/users/f6d218fe667f4bc9b02b453116166897` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.424523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8e9d1-d931-4abd-b93a-d44e1e81c671 None admin] RBAC: Authorizing `identity:get_user(user_id=f6d218fe667f4bc9b02b453116166897)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:17.425958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8e9d1-d931-4abd-b93a-d44e1e81c671 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:17.427641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 159/308] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:17 2022] GET /identity/v3/users/f6d218fe667f4bc9b02b453116166897 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:17.428434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8e9d1-d931-4abd-b93a-d44e1e81c671 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.483905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 150/309] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Jun 28 11:55:17 2022] POST /identity/v3/groups => generated 229 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:55:17.483905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380033ce-395e-4391-a48e-372f90640491 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.544705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8e9d1-d931-4abd-b93a-d44e1e81c671 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.568421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:17.591362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e7513-7505-40a5-9b20-0ae7c894e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.592562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e7513-7505-40a5-9b20-0ae7c894e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.592847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e7513-7505-40a5-9b20-0ae7c894e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.593120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e7513-7505-40a5-9b20-0ae7c894e0d8 None admin] PATH_INFO: `/v3/users/0155a9e6313e48719f13e8ecb5db3ab3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.594401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e7513-7505-40a5-9b20-0ae7c894e0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=0155a9e6313e48719f13e8ecb5db3ab3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:17.595921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e7513-7505-40a5-9b20-0ae7c894e0d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:17.598071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 160/310] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:17 2022] GET /identity/v3/users/0155a9e6313e48719f13e8ecb5db3ab3 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:17.604190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e7513-7505-40a5-9b20-0ae7c894e0d8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.607094 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380033ce-395e-4391-a48e-372f90640491 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.638395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:17.649024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f85385-2f6b-4ab1-a9a4-50d16d9f1117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.650023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f85385-2f6b-4ab1-a9a4-50d16d9f1117 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.650099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f85385-2f6b-4ab1-a9a4-50d16d9f1117 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.650361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f85385-2f6b-4ab1-a9a4-50d16d9f1117 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.662416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f85385-2f6b-4ab1-a9a4-50d16d9f1117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-97f85385-2f6b-4ab1-a9a4-50d16d9f1117 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:17.670913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:17.671897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:17.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 151/311] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:17.673610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f85385-2f6b-4ab1-a9a4-50d16d9f1117 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.718972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e7513-7505-40a5-9b20-0ae7c894e0d8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.754558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eeb63-3a82-4943-af35-54a4c69d7788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.756178 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eeb63-3a82-4943-af35-54a4c69d7788 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.756459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eeb63-3a82-4943-af35-54a4c69d7788 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.756731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eeb63-3a82-4943-af35-54a4c69d7788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.757568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eeb63-3a82-4943-af35-54a4c69d7788 None admin] RBAC: Adding query filter params (role.id=57d52c1b0a1443818028148b95eb44f6, user.id=f6d218fe667f4bc9b02b453116166897, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:17.757881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eeb63-3a82-4943-af35-54a4c69d7788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:17.759409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eeb63-3a82-4943-af35-54a4c69d7788 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:17.764797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 161/312] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Jun 28 11:55:17 2022] GET /identity/v3/role_assignments?user.id=f6d218fe667f4bc9b02b453116166897&scope.system=all&role.id=57d52c1b0a1443818028148b95eb44f6 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:17.765594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eeb63-3a82-4943-af35-54a4c69d7788 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.800462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f85385-2f6b-4ab1-a9a4-50d16d9f1117 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.831559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:17.852711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0beb15-fbc4-46d4-9744-56b41c54b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.854599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0beb15-fbc4-46d4-9744-56b41c54b981 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.855169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0beb15-fbc4-46d4-9744-56b41c54b981 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.856111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0beb15-fbc4-46d4-9744-56b41c54b981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.892700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eeb63-3a82-4943-af35-54a4c69d7788 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:17.933605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac412-3e24-42d1-8eaa-cf7d6542cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:17.934284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac412-3e24-42d1-8eaa-cf7d6542cf7f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:17.934569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac412-3e24-42d1-8eaa-cf7d6542cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:17.934838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac412-3e24-42d1-8eaa-cf7d6542cf7f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:17.935602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac412-3e24-42d1-8eaa-cf7d6542cf7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:17.935936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac412-3e24-42d1-8eaa-cf7d6542cf7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:17.936844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:17.938590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac412-3e24-42d1-8eaa-cf7d6542cf7f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:17.948311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 162/313] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:17.955072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac412-3e24-42d1-8eaa-cf7d6542cf7f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:17.961988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0beb15-fbc4-46d4-9744-56b41c54b981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:17.964876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0beb15-fbc4-46d4-9744-56b41c54b981 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:18.065520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac412-3e24-42d1-8eaa-cf7d6542cf7f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:18.072251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 152/314] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:18.076155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:18.078520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0beb15-fbc4-46d4-9744-56b41c54b981 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:18.101344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba93de5-23fa-4038-9077-8d7e599464a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:18.102229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba93de5-23fa-4038-9077-8d7e599464a6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:18.102510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba93de5-23fa-4038-9077-8d7e599464a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:18.102837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba93de5-23fa-4038-9077-8d7e599464a6 None admin] PATH_INFO: `/v3/users/a97f628d7b25433a9c191cd08073b4d1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:18.104370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba93de5-23fa-4038-9077-8d7e599464a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a97f628d7b25433a9c191cd08073b4d1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:18.106018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba93de5-23fa-4038-9077-8d7e599464a6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:18.108096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 163/315] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:17 2022] GET /identity/v3/users/a97f628d7b25433a9c191cd08073b4d1 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:18.113940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba93de5-23fa-4038-9077-8d7e599464a6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:18.174555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:18.194274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0beb15-fbc4-46d4-9744-56b41c54b981 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:18.238820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba93de5-23fa-4038-9077-8d7e599464a6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:18.242289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811876e-dc3b-4d44-8f87-b8acea360821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:18.243154 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811876e-dc3b-4d44-8f87-b8acea360821 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:18.243434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811876e-dc3b-4d44-8f87-b8acea360821 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:18.243709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811876e-dc3b-4d44-8f87-b8acea360821 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:18.244964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811876e-dc3b-4d44-8f87-b8acea360821 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:18.246414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811876e-dc3b-4d44-8f87-b8acea360821 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:18.248362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 153/316] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:18 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:18.253874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811876e-dc3b-4d44-8f87-b8acea360821 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:18.282736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ceaa9-751c-4124-aa4b-9495420c2ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:18.283773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ceaa9-751c-4124-aa4b-9495420c2ade None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:18.284090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ceaa9-751c-4124-aa4b-9495420c2ade None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:18.284372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ceaa9-751c-4124-aa4b-9495420c2ade None admin] PATH_INFO: `/v3/system/users/a97f628d7b25433a9c191cd08073b4d1/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:18.286565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ceaa9-751c-4124-aa4b-9495420c2ade None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a97f628d7b25433a9c191cd08073b4d1, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:18.288505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ceaa9-751c-4124-aa4b-9495420c2ade None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:18.365942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811876e-dc3b-4d44-8f87-b8acea360821 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:18.399985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 164/317] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Jun 28 11:55:18 2022] PUT /identity/v3/system/users/a97f628d7b25433a9c191cd08073b4d1/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:18.407504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df518461-a33e-43fc-bce0-481003710ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:18.407504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df518461-a33e-43fc-bce0-481003710ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:18.407504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df518461-a33e-43fc-bce0-481003710ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:18.407504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df518461-a33e-43fc-bce0-481003710ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:18.407889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df518461-a33e-43fc-bce0-481003710ed6 None admin] RBAC: Adding query filter params (role.id=57d52c1b0a1443818028148b95eb44f6, scope.project.id=a39345b421b846488684793b6a430379, user.id=0155a9e6313e48719f13e8ecb5db3ab3) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:18.407889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df518461-a33e-43fc-bce0-481003710ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:18.407889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df518461-a33e-43fc-bce0-481003710ed6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:18.413681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 154/318] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:18 2022] GET /identity/v3/role_assignments?user.id=0155a9e6313e48719f13e8ecb5db3ab3&scope.project.id=a39345b421b846488684793b6a430379&role.id=57d52c1b0a1443818028148b95eb44f6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:19.607844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6434418-e20a-4b2c-92c3-0e5f2524a281 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:19.608479 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6434418-e20a-4b2c-92c3-0e5f2524a281 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:19.608479 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6434418-e20a-4b2c-92c3-0e5f2524a281 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:19.609948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 165/319] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:19.615730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55de3b0-a8f5-4349-ba3f-8a11514916db None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:19.616159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55de3b0-a8f5-4349-ba3f-8a11514916db None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:19.616339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55de3b0-a8f5-4349-ba3f-8a11514916db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:19.633541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d55de3b0-a8f5-4349-ba3f-8a11514916db None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:19.634735 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d55de3b0-a8f5-4349-ba3f-8a11514916db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:19.648253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:19.702169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 155/320] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:19.725534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6434418-e20a-4b2c-92c3-0e5f2524a281 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:19.772272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:19.828958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6434418-e20a-4b2c-92c3-0e5f2524a281 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:19.858205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66848abe-76ca-4be6-841b-70f553b52657 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:19.858489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66848abe-76ca-4be6-841b-70f553b52657 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:19.858766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66848abe-76ca-4be6-841b-70f553b52657 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:19.860572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 156/321] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:55:19.866272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb131d6d-3de0-4b30-a82c-f09cbde171a3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:19.866813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb131d6d-3de0-4b30-a82c-f09cbde171a3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:19.867287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb131d6d-3de0-4b30-a82c-f09cbde171a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:19.868384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a5453-3546-4420-9819-c695600ae3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:19.869187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a5453-3546-4420-9819-c695600ae3da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:19.869462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a5453-3546-4420-9819-c695600ae3da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:19.869746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a5453-3546-4420-9819-c695600ae3da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:19.870912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a5453-3546-4420-9819-c695600ae3da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:19.872404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a5453-3546-4420-9819-c695600ae3da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:19.874151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 166/322] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:19.879370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a5453-3546-4420-9819-c695600ae3da None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:19.890148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bb131d6d-3de0-4b30-a82c-f09cbde171a3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:19.891563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bb131d6d-3de0-4b30-a82c-f09cbde171a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:19.961213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 157/323] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:19.984280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb131d6d-3de0-4b30-a82c-f09cbde171a3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:19.984841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a5453-3546-4420-9819-c695600ae3da None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:19.996757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:20.021295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081453f5-b4d9-47a1-9c3c-37cc1d282b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:20.021970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081453f5-b4d9-47a1-9c3c-37cc1d282b4b None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:20.022253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081453f5-b4d9-47a1-9c3c-37cc1d282b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:20.022530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081453f5-b4d9-47a1-9c3c-37cc1d282b4b None admin] PATH_INFO: `/v3/groups` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:20.023227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081453f5-b4d9-47a1-9c3c-37cc1d282b4b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:20.024703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081453f5-b4d9-47a1-9c3c-37cc1d282b4b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:20.065326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:20.086593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb131d6d-3de0-4b30-a82c-f09cbde171a3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:20.122028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f268099-21f9-47e9-bcc1-a710bfb4d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:20.122828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f268099-21f9-47e9-bcc1-a710bfb4d026 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:20.123111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f268099-21f9-47e9-bcc1-a710bfb4d026 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:20.123389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f268099-21f9-47e9-bcc1-a710bfb4d026 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:20.134012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f268099-21f9-47e9-bcc1-a710bfb4d026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5f268099-21f9-47e9-bcc1-a710bfb4d026 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:20.141840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:20.142680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:20.143682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 158/324] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:20.149974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f268099-21f9-47e9-bcc1-a710bfb4d026 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:20.155522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 167/325] 10.222.0.49 () {60 vars in 1134 bytes} [Tue Jun 28 11:55:19 2022] POST /identity/v3/groups => generated 226 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 11:55:20.282374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f268099-21f9-47e9-bcc1-a710bfb4d026 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:20.321179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47308d9c-8c4e-422f-bd3f-55cb0551e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:20.321855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47308d9c-8c4e-422f-bd3f-55cb0551e992 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:20.322139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47308d9c-8c4e-422f-bd3f-55cb0551e992 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:20.322416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47308d9c-8c4e-422f-bd3f-55cb0551e992 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:20.323169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47308d9c-8c4e-422f-bd3f-55cb0551e992 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:20.323480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47308d9c-8c4e-422f-bd3f-55cb0551e992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:20.324954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47308d9c-8c4e-422f-bd3f-55cb0551e992 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:20.330224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:20.335529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 159/326] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:20.343469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081453f5-b4d9-47a1-9c3c-37cc1d282b4b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:20.462122 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081453f5-b4d9-47a1-9c3c-37cc1d282b4b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:20.498538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a33a2b-4688-4127-94f1-996704e0c8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:20.499409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886756-2063-45a1-b571-f73d2130e632 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:20.499521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a33a2b-4688-4127-94f1-996704e0c8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:20.499696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a33a2b-4688-4127-94f1-996704e0c8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:20.499808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886756-2063-45a1-b571-f73d2130e632 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:20.499988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29886756-2063-45a1-b571-f73d2130e632 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:20.500077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a33a2b-4688-4127-94f1-996704e0c8d4 None admin] PATH_INFO: `/v3/users/f6d218fe667f4bc9b02b453116166897` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:20.501504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a33a2b-4688-4127-94f1-996704e0c8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f6d218fe667f4bc9b02b453116166897)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:20.501608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 160/327] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:55:20.504281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a33a2b-4688-4127-94f1-996704e0c8d4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:20.507316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 168/328] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:20 2022] GET /identity/v3/users/f6d218fe667f4bc9b02b453116166897 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:20.507507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab2950-baa2-4c0e-9cea-18f452ddf8a8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:20.507908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab2950-baa2-4c0e-9cea-18f452ddf8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:20.508093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab2950-baa2-4c0e-9cea-18f452ddf8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:20.513238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a33a2b-4688-4127-94f1-996704e0c8d4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:20.526418 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d0ab2950-baa2-4c0e-9cea-18f452ddf8a8 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:20.527551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d0ab2950-baa2-4c0e-9cea-18f452ddf8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:20.565698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:20.626349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 161/329] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:20.644062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a33a2b-4688-4127-94f1-996704e0c8d4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:20.654905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab2950-baa2-4c0e-9cea-18f452ddf8a8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:20.702098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40109a7-870a-4dc2-83b4-e7568200d56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:20.702978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40109a7-870a-4dc2-83b4-e7568200d56a None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:20.703258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40109a7-870a-4dc2-83b4-e7568200d56a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:20.703537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40109a7-870a-4dc2-83b4-e7568200d56a None admin] PATH_INFO: `/v3/system/users/f6d218fe667f4bc9b02b453116166897/roles/57d52c1b0a1443818028148b95eb44f6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:20.705080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40109a7-870a-4dc2-83b4-e7568200d56a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f6d218fe667f4bc9b02b453116166897, role_id=57d52c1b0a1443818028148b95eb44f6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:20.706459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40109a7-870a-4dc2-83b4-e7568200d56a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:20.772457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 169/330] 10.222.0.49 () {58 vars in 1334 bytes} [Tue Jun 28 11:55:20 2022] PUT /identity/v3/system/users/f6d218fe667f4bc9b02b453116166897/roles/57d52c1b0a1443818028148b95eb44f6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 11:55:20.779208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab2950-baa2-4c0e-9cea-18f452ddf8a8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:20.815585 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:20.821620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c93a0-cfa9-428a-a327-62e434d8fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:20.822443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c93a0-cfa9-428a-a327-62e434d8fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:20.822728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c93a0-cfa9-428a-a327-62e434d8fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:20.823004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c93a0-cfa9-428a-a327-62e434d8fbc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:20.835217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c93a0-cfa9-428a-a327-62e434d8fbc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-729c93a0-cfa9-428a-a327-62e434d8fbc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:20.843222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:20.844420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:20.845305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 162/331] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:20.854153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40109a7-870a-4dc2-83b4-e7568200d56a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:20.989248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40109a7-870a-4dc2-83b4-e7568200d56a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:20.990917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:21.029113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f60768-1fd3-448d-bd0d-407ce35abd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:21.030205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f60768-1fd3-448d-bd0d-407ce35abd38 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:21.030798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f60768-1fd3-448d-bd0d-407ce35abd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:21.031298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f60768-1fd3-448d-bd0d-407ce35abd38 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:21.032322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f60768-1fd3-448d-bd0d-407ce35abd38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:21.032873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f60768-1fd3-448d-bd0d-407ce35abd38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:21.034476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f60768-1fd3-448d-bd0d-407ce35abd38 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:21.044889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 170/332] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:21.050654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c93a0-cfa9-428a-a327-62e434d8fbc0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:21.194081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c93a0-cfa9-428a-a327-62e434d8fbc0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:21.232263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e5328-8088-4a67-9f29-a38af8c42a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:21.233149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e5328-8088-4a67-9f29-a38af8c42a82 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:21.233431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e5328-8088-4a67-9f29-a38af8c42a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:21.233711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e5328-8088-4a67-9f29-a38af8c42a82 None admin] PATH_INFO: `/v3/users/a97f628d7b25433a9c191cd08073b4d1` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:21.234924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e5328-8088-4a67-9f29-a38af8c42a82 None admin] RBAC: Authorizing `identity:get_user(user_id=a97f628d7b25433a9c191cd08073b4d1)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:21.236415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e5328-8088-4a67-9f29-a38af8c42a82 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:21.241260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 163/333] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:21 2022] GET /identity/v3/users/a97f628d7b25433a9c191cd08073b4d1 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:21.246824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f60768-1fd3-448d-bd0d-407ce35abd38 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:21.495029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f60768-1fd3-448d-bd0d-407ce35abd38 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:21.549979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5538f-8ead-4b02-ae18-1ac9b8fbcb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:21.550653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5538f-8ead-4b02-ae18-1ac9b8fbcb59 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:21.550939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5538f-8ead-4b02-ae18-1ac9b8fbcb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:21.551218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5538f-8ead-4b02-ae18-1ac9b8fbcb59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:21.552419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5538f-8ead-4b02-ae18-1ac9b8fbcb59 None admin] RBAC: Adding query filter params (role.id=060d4fd81b0744fd9118c205f3961d49, user.id=a97f628d7b25433a9c191cd08073b4d1, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:21.552734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5538f-8ead-4b02-ae18-1ac9b8fbcb59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:21.554191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5538f-8ead-4b02-ae18-1ac9b8fbcb59 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:21.569514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 171/334] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Jun 28 11:55:21 2022] GET /identity/v3/role_assignments?user.id=a97f628d7b25433a9c191cd08073b4d1&scope.system=all&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 510 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:22.573549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ddb1-d850-455f-9e1e-21b7d576e1c1 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:22.574050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ddb1-d850-455f-9e1e-21b7d576e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:22.574124 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0ddb1-d850-455f-9e1e-21b7d576e1c1 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:22.575700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 164/335] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:22.580976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0f05-82ce-4521-a90c-479492916725 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:22.581788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0f05-82ce-4521-a90c-479492916725 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:22.582285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0f05-82ce-4521-a90c-479492916725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:22.604336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-109e0f05-82ce-4521-a90c-479492916725 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:22.605882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-109e0f05-82ce-4521-a90c-479492916725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:22.628012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:22.687982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 172/336] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:22.722071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0ddb1-d850-455f-9e1e-21b7d576e1c1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:22.804210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:22.860074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0ddb1-d850-455f-9e1e-21b7d576e1c1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:22.900075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6e455-b231-481c-9926-3dd67cf512c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:22.901248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6e455-b231-481c-9926-3dd67cf512c8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:22.901732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6e455-b231-481c-9926-3dd67cf512c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:22.902221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6e455-b231-481c-9926-3dd67cf512c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:22.917537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6e455-b231-481c-9926-3dd67cf512c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-1bb6e455-b231-481c-9926-3dd67cf512c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:22.925741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:22.927265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:22.928338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:22.931338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 165/337] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:22.936774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0f05-82ce-4521-a90c-479492916725 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:23.050614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0f05-82ce-4521-a90c-479492916725 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:23.090991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80974d0-61ac-4a99-ac3c-06a5fcaa229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:23.092064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80974d0-61ac-4a99-ac3c-06a5fcaa229d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:23.092549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80974d0-61ac-4a99-ac3c-06a5fcaa229d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:23.093035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80974d0-61ac-4a99-ac3c-06a5fcaa229d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:23.093997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80974d0-61ac-4a99-ac3c-06a5fcaa229d None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:23.094502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80974d0-61ac-4a99-ac3c-06a5fcaa229d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:23.096114 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80974d0-61ac-4a99-ac3c-06a5fcaa229d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:23.110012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 173/338] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:23.116042 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6e455-b231-481c-9926-3dd67cf512c8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:23.234248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6e455-b231-481c-9926-3dd67cf512c8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:23.259318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:23.277017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516f86-d43a-4baf-8563-d9f941b75012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:23.278070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516f86-d43a-4baf-8563-d9f941b75012 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:23.278555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516f86-d43a-4baf-8563-d9f941b75012 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:23.279026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516f86-d43a-4baf-8563-d9f941b75012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:23.360232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79516f86-d43a-4baf-8563-d9f941b75012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:23.362136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79516f86-d43a-4baf-8563-d9f941b75012 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:23.437211 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43584bc6-6d8e-4b9c-a259-e38dff2e7ecc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:23.437527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43584bc6-6d8e-4b9c-a259-e38dff2e7ecc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:23.437764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43584bc6-6d8e-4b9c-a259-e38dff2e7ecc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:23.439131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 174/339] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:55:23.444912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71455d33-6d9a-41b6-9ed9-fdd956990e19 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:23.444912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71455d33-6d9a-41b6-9ed9-fdd956990e19 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:23.444912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71455d33-6d9a-41b6-9ed9-fdd956990e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:23.463034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-71455d33-6d9a-41b6-9ed9-fdd956990e19 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:23.465116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-71455d33-6d9a-41b6-9ed9-fdd956990e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:23.486340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:23.526081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 166/340] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:23.531250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516f86-d43a-4baf-8563-d9f941b75012 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:23.569198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:23.586182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 175/341] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:23.612174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6c33-1620-4d39-bfbf-e8da51701d40 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:23.612839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6c33-1620-4d39-bfbf-e8da51701d40 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:23.613337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6c33-1620-4d39-bfbf-e8da51701d40 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:23.616485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 176/342] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:55:23.626555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea571909-5ac8-4f10-929e-30f7c03f8e60 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:23.627124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea571909-5ac8-4f10-929e-30f7c03f8e60 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:23.627604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea571909-5ac8-4f10-929e-30f7c03f8e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:23.651324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ea571909-5ac8-4f10-929e-30f7c03f8e60 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:23.652952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea571909-5ac8-4f10-929e-30f7c03f8e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:23.713230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516f86-d43a-4baf-8563-d9f941b75012 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:23.736630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 177/343] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 28 11:55:23.737797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea571909-5ac8-4f10-929e-30f7c03f8e60 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:23.779912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284d8c6-4d89-4a36-8252-a40de7a85b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:23.780470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284d8c6-4d89-4a36-8252-a40de7a85b5f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:23.780750 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284d8c6-4d89-4a36-8252-a40de7a85b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:23.781022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284d8c6-4d89-4a36-8252-a40de7a85b5f None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:23.784643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284d8c6-4d89-4a36-8252-a40de7a85b5f None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:23.786680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284d8c6-4d89-4a36-8252-a40de7a85b5f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:23.788349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 167/344] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:23 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:23.789123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284d8c6-4d89-4a36-8252-a40de7a85b5f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:23.828219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:23.857401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea571909-5ac8-4f10-929e-30f7c03f8e60 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:23.898747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99860f23-9848-4368-bde0-d54fa050813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:23.899922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860f23-9848-4368-bde0-d54fa050813a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:23.900413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860f23-9848-4368-bde0-d54fa050813a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:23.900889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860f23-9848-4368-bde0-d54fa050813a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:23.913640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99860f23-9848-4368-bde0-d54fa050813a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-99860f23-9848-4368-bde0-d54fa050813a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:23.922094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:23.922933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:23.923710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:23.926619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 178/345] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:23.928087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99860f23-9848-4368-bde0-d54fa050813a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:23.951933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:23.983449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284d8c6-4d89-4a36-8252-a40de7a85b5f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:24.024111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12ba38-1b47-4701-9dd2-c083dce9381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:24.024940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12ba38-1b47-4701-9dd2-c083dce9381a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:24.025228 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12ba38-1b47-4701-9dd2-c083dce9381a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:24.025507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12ba38-1b47-4701-9dd2-c083dce9381a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:24.040274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12ba38-1b47-4701-9dd2-c083dce9381a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:24.044836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99860f23-9848-4368-bde0-d54fa050813a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-dc12ba38-1b47-4701-9dd2-c083dce9381a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:24.048749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:24.049646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:24.050566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 168/346] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:24.051227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12ba38-1b47-4701-9dd2-c083dce9381a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:24.087268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef980-cfdb-4ec7-88af-68bf7d033c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:24.088691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef980-cfdb-4ec7-88af-68bf7d033c6a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:24.089327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef980-cfdb-4ec7-88af-68bf7d033c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:24.089806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ef980-cfdb-4ec7-88af-68bf7d033c6a None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:24.096867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef980-cfdb-4ec7-88af-68bf7d033c6a None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:24.099980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ef980-cfdb-4ec7-88af-68bf7d033c6a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:24.103030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:24.107895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 179/347] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:23 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:24.107895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef980-cfdb-4ec7-88af-68bf7d033c6a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:24.172486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12ba38-1b47-4701-9dd2-c083dce9381a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:24.210712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cad3fc-457c-41f4-91f4-c332a99a6c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:24.211395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cad3fc-457c-41f4-91f4-c332a99a6c29 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:24.211683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cad3fc-457c-41f4-91f4-c332a99a6c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:24.212005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cad3fc-457c-41f4-91f4-c332a99a6c29 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:24.212773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cad3fc-457c-41f4-91f4-c332a99a6c29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:24.213088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cad3fc-457c-41f4-91f4-c332a99a6c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:24.214498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cad3fc-457c-41f4-91f4-c332a99a6c29 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:24.224983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 169/348] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:24.225825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cad3fc-457c-41f4-91f4-c332a99a6c29 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:24.233273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ef980-cfdb-4ec7-88af-68bf7d033c6a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:24.248296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:24.289107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea373a-712d-4d01-9374-bfcfdbfbef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:24.290150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea373a-712d-4d01-9374-bfcfdbfbef8e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:24.290510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea373a-712d-4d01-9374-bfcfdbfbef8e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:24.290865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea373a-712d-4d01-9374-bfcfdbfbef8e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:24.292051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea373a-712d-4d01-9374-bfcfdbfbef8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:24.292834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea373a-712d-4d01-9374-bfcfdbfbef8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:24.294428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea373a-712d-4d01-9374-bfcfdbfbef8e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:24.306052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 180/349] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:24.307163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea373a-712d-4d01-9374-bfcfdbfbef8e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:24.376745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cad3fc-457c-41f4-91f4-c332a99a6c29 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:24.393360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:24.428160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317db52c-a92d-4a22-acb3-c1dbcc01c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:24.428748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317db52c-a92d-4a22-acb3-c1dbcc01c84b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:24.429036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317db52c-a92d-4a22-acb3-c1dbcc01c84b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:24.429316 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317db52c-a92d-4a22-acb3-c1dbcc01c84b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:24.430169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317db52c-a92d-4a22-acb3-c1dbcc01c84b None admin] RBAC: Adding query filter params (group.id=d19c16f4fe1b439a8fc36ac6bfda43ec, role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:24.430485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317db52c-a92d-4a22-acb3-c1dbcc01c84b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:24.432001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317db52c-a92d-4a22-acb3-c1dbcc01c84b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:24.442655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 170/350] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:24 2022] GET /identity/v3/role_assignments?group.id=d19c16f4fe1b439a8fc36ac6bfda43ec&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:24.445390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c8f1-b1e0-4f40-bfa6-f6259a07e4ed None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:24.445742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c8f1-b1e0-4f40-bfa6-f6259a07e4ed None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:24.446032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c8f1-b1e0-4f40-bfa6-f6259a07e4ed None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:24.446639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea373a-712d-4d01-9374-bfcfdbfbef8e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:24.447712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 171/351] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:24.448935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c8f1-b1e0-4f40-bfa6-f6259a07e4ed None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:24.495243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96e2f2-9d19-42e7-bd38-26517b5c84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:24.495961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96e2f2-9d19-42e7-bd38-26517b5c84d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:24.496254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96e2f2-9d19-42e7-bd38-26517b5c84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:24.496537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96e2f2-9d19-42e7-bd38-26517b5c84d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:24.564342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:24.588498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96e2f2-9d19-42e7-bd38-26517b5c84d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:24.589987 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96e2f2-9d19-42e7-bd38-26517b5c84d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:24.611565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c8f1-b1e0-4f40-bfa6-f6259a07e4ed None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:24.662260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:24.671257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f4b4c-008e-496d-a990-d2df295e1560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:24.672060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f4b4c-008e-496d-a990-d2df295e1560 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:24.672340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f4b4c-008e-496d-a990-d2df295e1560 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:24.677725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f4b4c-008e-496d-a990-d2df295e1560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:24.717457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 181/352] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:24.724545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a15bd-2556-4068-be7b-9862bea369e1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:24.724894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a15bd-2556-4068-be7b-9862bea369e1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:24.725187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a15bd-2556-4068-be7b-9862bea369e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:24.744628 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2a6a15bd-2556-4068-be7b-9862bea369e1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:24.745870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2a6a15bd-2556-4068-be7b-9862bea369e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:24.771350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f4b4c-008e-496d-a990-d2df295e1560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:24.773438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f4b4c-008e-496d-a990-d2df295e1560 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:24.830672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 182/353] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:24.831677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a15bd-2556-4068-be7b-9862bea369e1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:24.868237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:24.908583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 172/354] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:24.909669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f4b4c-008e-496d-a990-d2df295e1560 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:24.954309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:24.966212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a15bd-2556-4068-be7b-9862bea369e1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.015162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a783-55bb-4308-a21c-5e25c9ea7cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.016171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a783-55bb-4308-a21c-5e25c9ea7cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.016668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a783-55bb-4308-a21c-5e25c9ea7cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.017049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57a783-55bb-4308-a21c-5e25c9ea7cd9 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.018415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57a783-55bb-4308-a21c-5e25c9ea7cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:25.019898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57a783-55bb-4308-a21c-5e25c9ea7cd9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:25.023661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 183/355] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:24 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:25.024507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a783-55bb-4308-a21c-5e25c9ea7cd9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:25.041683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f4b4c-008e-496d-a990-d2df295e1560 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.089748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3ca77-d945-4668-a8f9-d8ea805feb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.091100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ca77-d945-4668-a8f9-d8ea805feb13 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.091382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ca77-d945-4668-a8f9-d8ea805feb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.091659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ca77-d945-4668-a8f9-d8ea805feb13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.107582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3ca77-d945-4668-a8f9-d8ea805feb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-26c3ca77-d945-4668-a8f9-d8ea805feb13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:25.118365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:25.119290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 11:55:25.120131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:25.120727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 173/356] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:25.122208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e2375-c23c-4c64-b77f-4f27e19cf55e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.122613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e2375-c23c-4c64-b77f-4f27e19cf55e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.122894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e2375-c23c-4c64-b77f-4f27e19cf55e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.124450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 174/357] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:25.125665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e2375-c23c-4c64-b77f-4f27e19cf55e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:25.147174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57a783-55bb-4308-a21c-5e25c9ea7cd9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.169206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:25.193655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad4cf3-ae11-45e9-8732-bd9b290d2226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.194830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad4cf3-ae11-45e9-8732-bd9b290d2226 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.195165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad4cf3-ae11-45e9-8732-bd9b290d2226 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.195445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad4cf3-ae11-45e9-8732-bd9b290d2226 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.196733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad4cf3-ae11-45e9-8732-bd9b290d2226 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:25.198972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad4cf3-ae11-45e9-8732-bd9b290d2226 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:25.201884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 184/358] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:25 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:25.203246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f9a4f-02b6-4766-9414-276aabb9ac6f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.203535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f9a4f-02b6-4766-9414-276aabb9ac6f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.203811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f9a4f-02b6-4766-9414-276aabb9ac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.230264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-243f9a4f-02b6-4766-9414-276aabb9ac6f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:25.231965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-243f9a4f-02b6-4766-9414-276aabb9ac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:25.263059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:25.263393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e2375-c23c-4c64-b77f-4f27e19cf55e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.306575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9ba4-1239-44bc-9201-f5d67d46922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.307911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9ba4-1239-44bc-9201-f5d67d46922a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.308255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9ba4-1239-44bc-9201-f5d67d46922a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.308574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9ba4-1239-44bc-9201-f5d67d46922a None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.309750 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9ba4-1239-44bc-9201-f5d67d46922a None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:25.311252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9ba4-1239-44bc-9201-f5d67d46922a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:25.313193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 175/359] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:25 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:25.313779 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9ba4-1239-44bc-9201-f5d67d46922a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:25.326858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 185/360] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:25.328496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f9a4f-02b6-4766-9414-276aabb9ac6f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:25.424978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:25.428480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9ba4-1239-44bc-9201-f5d67d46922a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.441376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f9a4f-02b6-4766-9414-276aabb9ac6f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.462894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921039f-c647-4983-9db1-0e75510efdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.463814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921039f-c647-4983-9db1-0e75510efdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.464285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921039f-c647-4983-9db1-0e75510efdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.464698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921039f-c647-4983-9db1-0e75510efdb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.465596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921039f-c647-4983-9db1-0e75510efdb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:25.466069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921039f-c647-4983-9db1-0e75510efdb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:25.467600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921039f-c647-4983-9db1-0e75510efdb4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:25.477409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 176/361] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:25.478775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921039f-c647-4983-9db1-0e75510efdb4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:25.479140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3379-8ed3-4d83-abc4-d20f0ec6bd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.480048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3379-8ed3-4d83-abc4-d20f0ec6bd9b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.480337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3379-8ed3-4d83-abc4-d20f0ec6bd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.480614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3379-8ed3-4d83-abc4-d20f0ec6bd9b None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.484607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f3379-8ed3-4d83-abc4-d20f0ec6bd9b None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:25.486073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f3379-8ed3-4d83-abc4-d20f0ec6bd9b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:25.487925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 186/362] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:25 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:25.488616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3379-8ed3-4d83-abc4-d20f0ec6bd9b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:25.547162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:25.604091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921039f-c647-4983-9db1-0e75510efdb4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.626567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3379-8ed3-4d83-abc4-d20f0ec6bd9b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.648297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af344e-9b51-4a2f-b7f8-55680e297fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.649630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af344e-9b51-4a2f-b7f8-55680e297fdd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.650088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af344e-9b51-4a2f-b7f8-55680e297fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.650519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af344e-9b51-4a2f-b7f8-55680e297fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.651512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af344e-9b51-4a2f-b7f8-55680e297fdd None admin] RBAC: Adding query filter params (group.id=d19c16f4fe1b439a8fc36ac6bfda43ec, role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=a39345b421b846488684793b6a430379) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:25.652023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af344e-9b51-4a2f-b7f8-55680e297fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:25.654076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af344e-9b51-4a2f-b7f8-55680e297fdd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:25.660364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 177/363] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:25 2022] GET /identity/v3/role_assignments?group.id=d19c16f4fe1b439a8fc36ac6bfda43ec&scope.project.id=a39345b421b846488684793b6a430379&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:25.663130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af344e-9b51-4a2f-b7f8-55680e297fdd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:25.675354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b31c6b-98d6-48dc-91fc-685dd2b77198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.676560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31c6b-98d6-48dc-91fc-685dd2b77198 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.678038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31c6b-98d6-48dc-91fc-685dd2b77198 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.678336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b31c6b-98d6-48dc-91fc-685dd2b77198 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.696429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b31c6b-98d6-48dc-91fc-685dd2b77198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:25.705907 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c3b31c6b-98d6-48dc-91fc-685dd2b77198 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:25.707407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:25.708971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:25.709803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:25.710433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 187/364] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:25.710994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b31c6b-98d6-48dc-91fc-685dd2b77198 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:25.804586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af344e-9b51-4a2f-b7f8-55680e297fdd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.832266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:25.850897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b31c6b-98d6-48dc-91fc-685dd2b77198 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:25.855434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b22cc-8c45-4178-8666-d94903688571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.857211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b22cc-8c45-4178-8666-d94903688571 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.857211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b22cc-8c45-4178-8666-d94903688571 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.857211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b22cc-8c45-4178-8666-d94903688571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.859282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b22cc-8c45-4178-8666-d94903688571 None admin] RBAC: Adding query filter params (group.id=d19c16f4fe1b439a8fc36ac6bfda43ec, role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:25.859282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b22cc-8c45-4178-8666-d94903688571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:25.860304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b22cc-8c45-4178-8666-d94903688571 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:25.868155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 178/365] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:25 2022] GET /identity/v3/role_assignments?group.id=d19c16f4fe1b439a8fc36ac6bfda43ec&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=478978f29ae748188de8d1a31490bb00 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:25.869328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8884-04f7-4bfb-8ef3-605ffd9bf634 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.870354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8884-04f7-4bfb-8ef3-605ffd9bf634 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.870638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad8884-04f7-4bfb-8ef3-605ffd9bf634 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.872292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 179/366] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:25.873044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad8884-04f7-4bfb-8ef3-605ffd9bf634 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:25.912731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fede9-d288-4e19-8370-ccadb9cfdf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:25.913750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fede9-d288-4e19-8370-ccadb9cfdf9c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.914035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fede9-d288-4e19-8370-ccadb9cfdf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.914407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fede9-d288-4e19-8370-ccadb9cfdf9c None admin] PATH_INFO: `/v3/users/f6d218fe667f4bc9b02b453116166897` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.915804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fede9-d288-4e19-8370-ccadb9cfdf9c None admin] RBAC: Authorizing `identity:get_user(user_id=f6d218fe667f4bc9b02b453116166897)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:25.917272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fede9-d288-4e19-8370-ccadb9cfdf9c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:25.919086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 188/367] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:55:25 2022] GET /identity/v3/users/f6d218fe667f4bc9b02b453116166897 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:25.920076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d454-0d65-4611-855f-9a4262469a8d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:25.920358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d454-0d65-4611-855f-9a4262469a8d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:25.920630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652d454-0d65-4611-855f-9a4262469a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:25.953944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d652d454-0d65-4611-855f-9a4262469a8d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:25.956992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d652d454-0d65-4611-855f-9a4262469a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:26.026569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:26.041252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad8884-04f7-4bfb-8ef3-605ffd9bf634 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:26.092201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cba9b8-4ca7-4221-b58c-270eb867d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:26.093901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cba9b8-4ca7-4221-b58c-270eb867d6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:26.094684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cba9b8-4ca7-4221-b58c-270eb867d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:26.095186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cba9b8-4ca7-4221-b58c-270eb867d6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:26.096496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cba9b8-4ca7-4221-b58c-270eb867d6a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:26.097521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cba9b8-4ca7-4221-b58c-270eb867d6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:26.099954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cba9b8-4ca7-4221-b58c-270eb867d6a1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:26.105349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 189/368] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:26.106241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d454-0d65-4611-855f-9a4262469a8d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:26.114948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 180/369] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:26.120561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cba9b8-4ca7-4221-b58c-270eb867d6a1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:26.213529 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:26.236934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652d454-0d65-4611-855f-9a4262469a8d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:26.274341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cba9b8-4ca7-4221-b58c-270eb867d6a1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:26.275500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809573e0-580a-4e0c-8d38-3c2031d6559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:26.276190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809573e0-580a-4e0c-8d38-3c2031d6559b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:26.276471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809573e0-580a-4e0c-8d38-3c2031d6559b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:26.276743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809573e0-580a-4e0c-8d38-3c2031d6559b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:26.277583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809573e0-580a-4e0c-8d38-3c2031d6559b None admin] RBAC: Adding query filter params (role.id=57d52c1b0a1443818028148b95eb44f6, user.id=f6d218fe667f4bc9b02b453116166897, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:26.277896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809573e0-580a-4e0c-8d38-3c2031d6559b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:26.280364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809573e0-580a-4e0c-8d38-3c2031d6559b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:26.294456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 190/370] 10.222.0.49 () {56 vars in 1308 bytes} [Tue Jun 28 11:55:26 2022] GET /identity/v3/role_assignments?user.id=f6d218fe667f4bc9b02b453116166897&scope.system=all&role.id=57d52c1b0a1443818028148b95eb44f6 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:26.295024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809573e0-580a-4e0c-8d38-3c2031d6559b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:26.325066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24075bf-233e-4e6a-96da-273b10662bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:26.326207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24075bf-233e-4e6a-96da-273b10662bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:26.327133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24075bf-233e-4e6a-96da-273b10662bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:26.327622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24075bf-233e-4e6a-96da-273b10662bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:26.363651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:26.425366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809573e0-580a-4e0c-8d38-3c2031d6559b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:26.442891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24075bf-233e-4e6a-96da-273b10662bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:26.445612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24075bf-233e-4e6a-96da-273b10662bc7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:26.478058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786939-d4b1-45af-a8d6-22217b79c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:26.478864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786939-d4b1-45af-a8d6-22217b79c6cf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:26.479146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786939-d4b1-45af-a8d6-22217b79c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:26.479424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786939-d4b1-45af-a8d6-22217b79c6cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:26.496590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:26.504302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10786939-d4b1-45af-a8d6-22217b79c6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-10786939-d4b1-45af-a8d6-22217b79c6cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:26.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:26.518315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:26.519185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 191/371] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:55:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:26.533223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786939-d4b1-45af-a8d6-22217b79c6cf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:26.659781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 181/372] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 11:55:26.666033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24075bf-233e-4e6a-96da-273b10662bc7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:26.732017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:26.795899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24075bf-233e-4e6a-96da-273b10662bc7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:26.797239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786939-d4b1-45af-a8d6-22217b79c6cf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:26.830471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec1306-d99e-406c-8668-ff7f2e83b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:26.831347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec1306-d99e-406c-8668-ff7f2e83b997 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:26.831631 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec1306-d99e-406c-8668-ff7f2e83b997 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:26.831929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec1306-d99e-406c-8668-ff7f2e83b997 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:26.833836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec1306-d99e-406c-8668-ff7f2e83b997 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:26.835525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec1306-d99e-406c-8668-ff7f2e83b997 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:26.841547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 182/373] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:26 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:26.842890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec1306-d99e-406c-8668-ff7f2e83b997 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:26.861169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ea6f9-d6c5-4bd6-9ca3-2b743292ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:26.862146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ea6f9-d6c5-4bd6-9ca3-2b743292ee05 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:26.862640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ea6f9-d6c5-4bd6-9ca3-2b743292ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:26.863097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ea6f9-d6c5-4bd6-9ca3-2b743292ee05 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:26.864807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ea6f9-d6c5-4bd6-9ca3-2b743292ee05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:26.865329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ea6f9-d6c5-4bd6-9ca3-2b743292ee05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:26.866956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ea6f9-d6c5-4bd6-9ca3-2b743292ee05 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:26.882196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 192/374] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:26.883728 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ea6f9-d6c5-4bd6-9ca3-2b743292ee05 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:26.959977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:26.966515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec1306-d99e-406c-8668-ff7f2e83b997 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:26.989135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:27.005592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c2221-ebe3-46dc-b8bc-8b0c7a48d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:27.006423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c2221-ebe3-46dc-b8bc-8b0c7a48d8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:27.006758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c2221-ebe3-46dc-b8bc-8b0c7a48d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:27.007172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c2221-ebe3-46dc-b8bc-8b0c7a48d8e3 None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:27.008391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c2221-ebe3-46dc-b8bc-8b0c7a48d8e3 None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:27.010051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c2221-ebe3-46dc-b8bc-8b0c7a48d8e3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:27.012775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 183/375] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:26 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:27.014463 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ea6f9-d6c5-4bd6-9ca3-2b743292ee05 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:27.017713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c2221-ebe3-46dc-b8bc-8b0c7a48d8e3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:27.061166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3862d-a7a4-4665-a6d4-7716b1287386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:27.062067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3862d-a7a4-4665-a6d4-7716b1287386 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:27.062202 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3862d-a7a4-4665-a6d4-7716b1287386 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:27.062379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3862d-a7a4-4665-a6d4-7716b1287386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:27.132714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c2221-ebe3-46dc-b8bc-8b0c7a48d8e3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:27.163908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3862d-a7a4-4665-a6d4-7716b1287386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:27.165400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3862d-a7a4-4665-a6d4-7716b1287386 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:27.170728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e42445-8afe-4cf4-b705-0c61691c6812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:27.171688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e42445-8afe-4cf4-b705-0c61691c6812 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:27.172302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e42445-8afe-4cf4-b705-0c61691c6812 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:27.172775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e42445-8afe-4cf4-b705-0c61691c6812 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:27.173907 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e42445-8afe-4cf4-b705-0c61691c6812 None admin] RBAC: Adding query filter params (group.id=d19c16f4fe1b439a8fc36ac6bfda43ec, role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=a39345b421b846488684793b6a430379) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:27.174418 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e42445-8afe-4cf4-b705-0c61691c6812 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:27.176104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e42445-8afe-4cf4-b705-0c61691c6812 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:27.183223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 184/376] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:27 2022] GET /identity/v3/role_assignments?group.id=d19c16f4fe1b439a8fc36ac6bfda43ec&scope.project.id=a39345b421b846488684793b6a430379&role.id=478978f29ae748188de8d1a31490bb00 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:27.243860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:27.287658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 193/377] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 11:55:27.297013 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e42445-8afe-4cf4-b705-0c61691c6812 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:27.358657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:27.412263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e42445-8afe-4cf4-b705-0c61691c6812 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:27.457826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda1634-ca26-41c4-b449-4d52b99776bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:27.459136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1634-ca26-41c4-b449-4d52b99776bc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:27.459639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1634-ca26-41c4-b449-4d52b99776bc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:27.460175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda1634-ca26-41c4-b449-4d52b99776bc None admin] PATH_INFO: `/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:27.461571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda1634-ca26-41c4-b449-4d52b99776bc None admin] RBAC: Authorizing `identity:get_project(project_id=34e93c67d4cd4a79a4295c88eb6ac57a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:27.463284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda1634-ca26-41c4-b449-4d52b99776bc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:27.465212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 185/378] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:27 2022] GET /identity/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:27.471061 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3862d-a7a4-4665-a6d4-7716b1287386 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:27.609260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3862d-a7a4-4665-a6d4-7716b1287386 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:27.653884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf61f9-9807-4a2d-9ec5-44d69dabbf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:27.654752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf61f9-9807-4a2d-9ec5-44d69dabbf61 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:27.655040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf61f9-9807-4a2d-9ec5-44d69dabbf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:27.655315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf61f9-9807-4a2d-9ec5-44d69dabbf61 None admin] PATH_INFO: `/v3/groups/987f91380a2042169829096318cd6b55` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:27.665564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf61f9-9807-4a2d-9ec5-44d69dabbf61 None admin] RBAC: Authorizing `identity:get_group(group_id=987f91380a2042169829096318cd6b55)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:27.667017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf61f9-9807-4a2d-9ec5-44d69dabbf61 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:27.668923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 194/379] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:27 2022] GET /identity/v3/groups/987f91380a2042169829096318cd6b55 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:27.676245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1450bfa-1f01-4bfc-86db-9a969e456246 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:27.676529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1450bfa-1f01-4bfc-86db-9a969e456246 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:27.676811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1450bfa-1f01-4bfc-86db-9a969e456246 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:27.678354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 186/380] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:27.679145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf61f9-9807-4a2d-9ec5-44d69dabbf61 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:27.685046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404342-4ed0-4a6f-92f6-1199864da7b0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:27.685592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404342-4ed0-4a6f-92f6-1199864da7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:27.686079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404342-4ed0-4a6f-92f6-1199864da7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:27.712703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:27.725233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-80404342-4ed0-4a6f-92f6-1199864da7b0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:27.730449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-80404342-4ed0-4a6f-92f6-1199864da7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:27.805750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf61f9-9807-4a2d-9ec5-44d69dabbf61 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:27.858206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eb337-91a1-44f6-96a4-e8baa007c558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:27.858865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb337-91a1-44f6-96a4-e8baa007c558 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:27.859145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb337-91a1-44f6-96a4-e8baa007c558 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:27.859419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb337-91a1-44f6-96a4-e8baa007c558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:27.860278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eb337-91a1-44f6-96a4-e8baa007c558 None admin] RBAC: Adding query filter params (group.id=987f91380a2042169829096318cd6b55, role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=34e93c67d4cd4a79a4295c88eb6ac57a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:27.860588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eb337-91a1-44f6-96a4-e8baa007c558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:27.862011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eb337-91a1-44f6-96a4-e8baa007c558 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:27.864303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 187/381] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:27.871145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 195/382] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:27 2022] GET /identity/v3/role_assignments?group.id=987f91380a2042169829096318cd6b55&scope.project.id=34e93c67d4cd4a79a4295c88eb6ac57a&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:27.913479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404342-4ed0-4a6f-92f6-1199864da7b0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:27.981399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:28.045586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404342-4ed0-4a6f-92f6-1199864da7b0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:28.091037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95257133-6238-49ee-8eac-ed3c633f34c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:28.091837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95257133-6238-49ee-8eac-ed3c633f34c2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:28.092142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95257133-6238-49ee-8eac-ed3c633f34c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:28.092419 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95257133-6238-49ee-8eac-ed3c633f34c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:28.109891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95257133-6238-49ee-8eac-ed3c633f34c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-95257133-6238-49ee-8eac-ed3c633f34c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:28.117645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:28.118573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:28.119437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 188/383] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:28.125166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eb337-91a1-44f6-96a4-e8baa007c558 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:28.228497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:28.242004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eb337-91a1-44f6-96a4-e8baa007c558 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:28.289641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e24e9-9e08-496a-b418-829908a75d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:28.290316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e24e9-9e08-496a-b418-829908a75d35 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:28.290598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e24e9-9e08-496a-b418-829908a75d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:28.290872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e24e9-9e08-496a-b418-829908a75d35 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:28.291629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e24e9-9e08-496a-b418-829908a75d35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:28.291959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e24e9-9e08-496a-b418-829908a75d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:28.293329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e24e9-9e08-496a-b418-829908a75d35 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:28.302902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 196/384] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:28.308523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95257133-6238-49ee-8eac-ed3c633f34c2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:28.427786 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95257133-6238-49ee-8eac-ed3c633f34c2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:28.439292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:28.467424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319282c-d68e-43c5-a4a8-5a729211f2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:28.468383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319282c-d68e-43c5-a4a8-5a729211f2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:28.468675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319282c-d68e-43c5-a4a8-5a729211f2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:28.468951 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319282c-d68e-43c5-a4a8-5a729211f2c1 None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:28.470201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319282c-d68e-43c5-a4a8-5a729211f2c1 None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:28.471665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319282c-d68e-43c5-a4a8-5a729211f2c1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:28.473843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 189/385] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:28 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:28.479194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e24e9-9e08-496a-b418-829908a75d35 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:28.483509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9ccd0-9c95-49fa-a3e1-259ea6b8acf2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:28.484047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9ccd0-9c95-49fa-a3e1-259ea6b8acf2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:28.484328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9ccd0-9c95-49fa-a3e1-259ea6b8acf2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:28.486882 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 190/386] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:28.496653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ede2c-f4f2-44d8-929b-65a6bd1f9ee8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:28.496964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ede2c-f4f2-44d8-929b-65a6bd1f9ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:28.497204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ede2c-f4f2-44d8-929b-65a6bd1f9ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:28.529576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f86ede2c-f4f2-44d8-929b-65a6bd1f9ee8 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:28.531116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f86ede2c-f4f2-44d8-929b-65a6bd1f9ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:28.654084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 191/387] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 28 11:55:28.680871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ede2c-f4f2-44d8-929b-65a6bd1f9ee8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:28.690404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e24e9-9e08-496a-b418-829908a75d35 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:28.763082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa94f49-5fe4-4e25-adda-ced3cb96eaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:28.763979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa94f49-5fe4-4e25-adda-ced3cb96eaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:28.764271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa94f49-5fe4-4e25-adda-ced3cb96eaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:28.764551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa94f49-5fe4-4e25-adda-ced3cb96eaa4 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:28.765885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa94f49-5fe4-4e25-adda-ced3cb96eaa4 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:28.767332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa94f49-5fe4-4e25-adda-ced3cb96eaa4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:28.772078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 197/388] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:28 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:28.778874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa94f49-5fe4-4e25-adda-ced3cb96eaa4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:28.820818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:28.896116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ede2c-f4f2-44d8-929b-65a6bd1f9ee8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:28.919362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:28.925515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa94f49-5fe4-4e25-adda-ced3cb96eaa4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:28.971509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b18c0-66e2-4a6e-9b35-eebe20d9c14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:28.972259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b18c0-66e2-4a6e-9b35-eebe20d9c14c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:28.972539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b18c0-66e2-4a6e-9b35-eebe20d9c14c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:28.972807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b18c0-66e2-4a6e-9b35-eebe20d9c14c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:28.990680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b18c0-66e2-4a6e-9b35-eebe20d9c14c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:28.994525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22030103-d402-4c45-b04a-53906b6a5a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:28.996629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22030103-d402-4c45-b04a-53906b6a5a3d None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:28.997090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22030103-d402-4c45-b04a-53906b6a5a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:28.997583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22030103-d402-4c45-b04a-53906b6a5a3d None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/groups/d19c16f4fe1b439a8fc36ac6bfda43ec/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-893b18c0-66e2-4a6e-9b35-eebe20d9c14c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:28.998888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:28.999977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:29.000987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 192/389] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:29.001802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877d45-6dcb-4745-a49c-5bb0346e14b2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:29.007903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877d45-6dcb-4745-a49c-5bb0346e14b2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:29.007903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa877d45-6dcb-4745-a49c-5bb0346e14b2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:29.007903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 193/390] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:29.008184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22030103-d402-4c45-b04a-53906b6a5a3d None admin] RBAC: Authorizing `identity:create_grant(project_id=9664179425e34ff98312ac1c4cdc1f0a, group_id=d19c16f4fe1b439a8fc36ac6bfda43ec, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:29.008184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22030103-d402-4c45-b04a-53906b6a5a3d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:29.008330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877d45-6dcb-4745-a49c-5bb0346e14b2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:29.120389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 198/391] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Jun 28 11:55:28 2022] PUT /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/groups/d19c16f4fe1b439a8fc36ac6bfda43ec/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:29.121723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612f6d-dfd3-43e5-952b-77c35731e992 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:29.122015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612f6d-dfd3-43e5-952b-77c35731e992 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:29.122294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612f6d-dfd3-43e5-952b-77c35731e992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:29.130661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa877d45-6dcb-4745-a49c-5bb0346e14b2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:29.164743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8a612f6d-dfd3-43e5-952b-77c35731e992 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:29.166065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a612f6d-dfd3-43e5-952b-77c35731e992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:29.183664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d1417-1fb5-47ff-94ef-18fd2bd9f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:29.184745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d1417-1fb5-47ff-94ef-18fd2bd9f5fd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:29.185224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d1417-1fb5-47ff-94ef-18fd2bd9f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:29.185673 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d1417-1fb5-47ff-94ef-18fd2bd9f5fd None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:29.186714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d1417-1fb5-47ff-94ef-18fd2bd9f5fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:29.187206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d1417-1fb5-47ff-94ef-18fd2bd9f5fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:29.188878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d1417-1fb5-47ff-94ef-18fd2bd9f5fd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:29.199994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 194/392] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:29.206078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d1417-1fb5-47ff-94ef-18fd2bd9f5fd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:29.242606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:29.323049 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d1417-1fb5-47ff-94ef-18fd2bd9f5fd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:29.350892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 199/393] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:29.368255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0f4c6-910e-4498-8a63-2d7e9fe89767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:29.369352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0f4c6-910e-4498-8a63-2d7e9fe89767 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:29.369738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0f4c6-910e-4498-8a63-2d7e9fe89767 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:29.370115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0f4c6-910e-4498-8a63-2d7e9fe89767 None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:29.372608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0f4c6-910e-4498-8a63-2d7e9fe89767 None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:29.374724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0f4c6-910e-4498-8a63-2d7e9fe89767 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:29.377301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 195/394] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:29 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:29.383102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a612f6d-dfd3-43e5-952b-77c35731e992 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:29.391446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0f4c6-910e-4498-8a63-2d7e9fe89767 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:29.399707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:29.546294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:29.553640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0f4c6-910e-4498-8a63-2d7e9fe89767 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:29.567314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a612f6d-dfd3-43e5-952b-77c35731e992 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:29.622522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40cf82-89ba-4cef-beab-246d021aaf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:29.624363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40cf82-89ba-4cef-beab-246d021aaf69 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:29.625374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40cf82-89ba-4cef-beab-246d021aaf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:29.625981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40cf82-89ba-4cef-beab-246d021aaf69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:29.633380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f5c05-3068-4270-ac85-b988bf3cb38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:29.634396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f5c05-3068-4270-ac85-b988bf3cb38c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:29.634606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f5c05-3068-4270-ac85-b988bf3cb38c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:29.634899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f5c05-3068-4270-ac85-b988bf3cb38c None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:29.639767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f5c05-3068-4270-ac85-b988bf3cb38c None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:29.639767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f5c05-3068-4270-ac85-b988bf3cb38c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:29.639767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 200/395] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:29 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:29.645507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f5c05-3068-4270-ac85-b988bf3cb38c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:29.650262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40cf82-89ba-4cef-beab-246d021aaf69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2f40cf82-89ba-4cef-beab-246d021aaf69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:29.667140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:29.668117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:29.668889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:29.671167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 196/396] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:29.680847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40cf82-89ba-4cef-beab-246d021aaf69 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:29.748768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:29.772633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f5c05-3068-4270-ac85-b988bf3cb38c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:29.812264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4297146-d4cf-4c47-8765-8cfab47f59fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:29.813076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4297146-d4cf-4c47-8765-8cfab47f59fb None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:29.813357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4297146-d4cf-4c47-8765-8cfab47f59fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:29.813630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4297146-d4cf-4c47-8765-8cfab47f59fb None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379/groups/d19c16f4fe1b439a8fc36ac6bfda43ec/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:29.816829 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4297146-d4cf-4c47-8765-8cfab47f59fb None admin] RBAC: Authorizing `identity:create_grant(project_id=a39345b421b846488684793b6a430379, group_id=d19c16f4fe1b439a8fc36ac6bfda43ec, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:29.818283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4297146-d4cf-4c47-8765-8cfab47f59fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:29.831863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40cf82-89ba-4cef-beab-246d021aaf69 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:29.872305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedea60-2bfc-4c6c-8345-072fa6181fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:29.873364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedea60-2bfc-4c6c-8345-072fa6181fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:29.873879 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedea60-2bfc-4c6c-8345-072fa6181fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:29.874366 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedea60-2bfc-4c6c-8345-072fa6181fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:29.875373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedea60-2bfc-4c6c-8345-072fa6181fa5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:29.875905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedea60-2bfc-4c6c-8345-072fa6181fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:29.877494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedea60-2bfc-4c6c-8345-072fa6181fa5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:29.887066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 197/397] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:29.892156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedea60-2bfc-4c6c-8345-072fa6181fa5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:29.907677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 201/398] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Jun 28 11:55:29 2022] PUT /identity/v3/projects/a39345b421b846488684793b6a430379/groups/d19c16f4fe1b439a8fc36ac6bfda43ec/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 11:55:29.918409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:30.007475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedea60-2bfc-4c6c-8345-072fa6181fa5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:30.047059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dcebc-0272-4599-9024-f63ddd94b0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:30.048034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dcebc-0272-4599-9024-f63ddd94b0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:30.048323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dcebc-0272-4599-9024-f63ddd94b0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:30.048618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dcebc-0272-4599-9024-f63ddd94b0e0 None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:30.049890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dcebc-0272-4599-9024-f63ddd94b0e0 None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:30.051392 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dcebc-0272-4599-9024-f63ddd94b0e0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:30.053692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 198/399] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:29 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:30.059189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4297146-d4cf-4c47-8765-8cfab47f59fb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:30.199854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41a91e-69af-4ecd-a6e5-2dd34cca0669 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:30.200247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41a91e-69af-4ecd-a6e5-2dd34cca0669 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:30.200455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41a91e-69af-4ecd-a6e5-2dd34cca0669 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:30.202167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 199/400] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:30.210340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4297146-d4cf-4c47-8765-8cfab47f59fb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:30.216311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abc5f6-e0d3-4efb-a272-75573ad564d2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:30.216610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abc5f6-e0d3-4efb-a272-75573ad564d2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:30.216892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abc5f6-e0d3-4efb-a272-75573ad564d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:30.253711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-47abc5f6-e0d3-4efb-a272-75573ad564d2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:30.256152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-47abc5f6-e0d3-4efb-a272-75573ad564d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:30.267723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a6783-0546-407a-8c21-fb859beb7154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:30.267723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a6783-0546-407a-8c21-fb859beb7154 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:30.267723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a6783-0546-407a-8c21-fb859beb7154 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:30.268077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a6783-0546-407a-8c21-fb859beb7154 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:30.269653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a6783-0546-407a-8c21-fb859beb7154 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:30.272431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a6783-0546-407a-8c21-fb859beb7154 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:30.273111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 202/401] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:30 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:30.278668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a6783-0546-407a-8c21-fb859beb7154 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:30.288359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:30.356205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 200/402] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:30.384983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abc5f6-e0d3-4efb-a272-75573ad564d2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:30.408491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:30.415494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a6783-0546-407a-8c21-fb859beb7154 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:30.459163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48829493-b215-4161-9a87-018cbddc6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:30.460063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48829493-b215-4161-9a87-018cbddc6c85 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:30.460348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48829493-b215-4161-9a87-018cbddc6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:30.460628 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48829493-b215-4161-9a87-018cbddc6c85 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/groups/d19c16f4fe1b439a8fc36ac6bfda43ec/roles/478978f29ae748188de8d1a31490bb00` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:30.463085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48829493-b215-4161-9a87-018cbddc6c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=9664179425e34ff98312ac1c4cdc1f0a, group_id=d19c16f4fe1b439a8fc36ac6bfda43ec, role_id=478978f29ae748188de8d1a31490bb00)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:30.464598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48829493-b215-4161-9a87-018cbddc6c85 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:30.496577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abc5f6-e0d3-4efb-a272-75573ad564d2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:30.542612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d00ac-c2f2-4801-83c4-c5c72befacb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:30.543473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d00ac-c2f2-4801-83c4-c5c72befacb0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:30.543760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d00ac-c2f2-4801-83c4-c5c72befacb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:30.544087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d00ac-c2f2-4801-83c4-c5c72befacb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:30.556096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d00ac-c2f2-4801-83c4-c5c72befacb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-340d00ac-c2f2-4801-83c4-c5c72befacb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:30.564259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:30.568903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:30.569716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 201/403] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:30.571490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d840-5849-49a5-ba92-1d86ab18404e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:30.571783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d840-5849-49a5-ba92-1d86ab18404e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:30.572086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d840-5849-49a5-ba92-1d86ab18404e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:30.573733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 202/404] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:30.578093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d840-5849-49a5-ba92-1d86ab18404e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:30.610270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 203/405] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Jun 28 11:55:30 2022] PUT /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a/groups/d19c16f4fe1b439a8fc36ac6bfda43ec/roles/478978f29ae748188de8d1a31490bb00 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:30.617821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5778cda-48d9-4a1a-9918-99b8988fd54f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:30.618387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5778cda-48d9-4a1a-9918-99b8988fd54f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:30.618904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5778cda-48d9-4a1a-9918-99b8988fd54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:30.658619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c5778cda-48d9-4a1a-9918-99b8988fd54f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:30.659865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c5778cda-48d9-4a1a-9918-99b8988fd54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:30.720312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:30.781983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d840-5849-49a5-ba92-1d86ab18404e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:30.793040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:30.802531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 204/406] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:30.825889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5778cda-48d9-4a1a-9918-99b8988fd54f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:30.833306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3d9cc-121d-4682-9469-73376c278184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:30.833989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3d9cc-121d-4682-9469-73376c278184 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:30.834274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3d9cc-121d-4682-9469-73376c278184 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:30.834549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3d9cc-121d-4682-9469-73376c278184 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:30.835313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3d9cc-121d-4682-9469-73376c278184 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:30.835622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3d9cc-121d-4682-9469-73376c278184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:30.837045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3d9cc-121d-4682-9469-73376c278184 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:30.846856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 203/407] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:30.854127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3d9cc-121d-4682-9469-73376c278184 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:30.979337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3d9cc-121d-4682-9469-73376c278184 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:31.016686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5778cda-48d9-4a1a-9918-99b8988fd54f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:31.058035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340ea49-69d4-49e1-8970-0df6f255d275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:31.058902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340ea49-69d4-49e1-8970-0df6f255d275 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.059185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340ea49-69d4-49e1-8970-0df6f255d275 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.059463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340ea49-69d4-49e1-8970-0df6f255d275 None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.061145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340ea49-69d4-49e1-8970-0df6f255d275 None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:31.062603 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340ea49-69d4-49e1-8970-0df6f255d275 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:31.064255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 204/408] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:30 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:31.064967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c12fa-26c7-48ce-a261-8ad71239660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:31.065776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c12fa-26c7-48ce-a261-8ad71239660e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.066092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c12fa-26c7-48ce-a261-8ad71239660e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.066399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c12fa-26c7-48ce-a261-8ad71239660e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.070778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340ea49-69d4-49e1-8970-0df6f255d275 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:31.093522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c12fa-26c7-48ce-a261-8ad71239660e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:31.100216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5d8c12fa-26c7-48ce-a261-8ad71239660e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:31.103344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:31.104239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:31.105029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:31.108060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 205/409] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:55:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:31.116858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c12fa-26c7-48ce-a261-8ad71239660e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:31.197345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340ea49-69d4-49e1-8970-0df6f255d275 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:31.234871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d74e7d-34d2-46d5-bdf9-a951326e62e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:31.235802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d74e7d-34d2-46d5-bdf9-a951326e62e2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.236188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d74e7d-34d2-46d5-bdf9-a951326e62e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.236916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d74e7d-34d2-46d5-bdf9-a951326e62e2 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.238205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d74e7d-34d2-46d5-bdf9-a951326e62e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:31.239947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d74e7d-34d2-46d5-bdf9-a951326e62e2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:31.242624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 205/410] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:31 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:31.249509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d74e7d-34d2-46d5-bdf9-a951326e62e2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:31.262181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:31.331419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c12fa-26c7-48ce-a261-8ad71239660e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:31.388338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:31.404507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121ac80-e776-4562-b891-4fa844e35440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:31.405208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121ac80-e776-4562-b891-4fa844e35440 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.405492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121ac80-e776-4562-b891-4fa844e35440 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.405769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121ac80-e776-4562-b891-4fa844e35440 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.406548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121ac80-e776-4562-b891-4fa844e35440 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:31.406860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121ac80-e776-4562-b891-4fa844e35440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:31.408472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121ac80-e776-4562-b891-4fa844e35440 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:31.415031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d74e7d-34d2-46d5-bdf9-a951326e62e2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:31.424488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 206/411] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:31.429745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121ac80-e776-4562-b891-4fa844e35440 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:31.459850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70533d-7a89-4ce5-a80e-71049d95a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:31.460773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70533d-7a89-4ce5-a80e-71049d95a679 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.461057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70533d-7a89-4ce5-a80e-71049d95a679 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.461335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70533d-7a89-4ce5-a80e-71049d95a679 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379/groups/d19c16f4fe1b439a8fc36ac6bfda43ec/roles/478978f29ae748188de8d1a31490bb00` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.463566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70533d-7a89-4ce5-a80e-71049d95a679 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39345b421b846488684793b6a430379, group_id=d19c16f4fe1b439a8fc36ac6bfda43ec, role_id=478978f29ae748188de8d1a31490bb00)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:31.465096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70533d-7a89-4ce5-a80e-71049d95a679 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:31.546725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121ac80-e776-4562-b891-4fa844e35440 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:31.573294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:31.578320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 206/412] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Jun 28 11:55:31 2022] PUT /identity/v3/projects/a39345b421b846488684793b6a430379/groups/d19c16f4fe1b439a8fc36ac6bfda43ec/roles/478978f29ae748188de8d1a31490bb00 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:31.589490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807707c-c905-4276-bd53-2841368a3ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:31.590443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807707c-c905-4276-bd53-2841368a3ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.590731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807707c-c905-4276-bd53-2841368a3ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.591100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807707c-c905-4276-bd53-2841368a3ca5 None admin] PATH_INFO: `/v3/groups/987f91380a2042169829096318cd6b55` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.592735 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807707c-c905-4276-bd53-2841368a3ca5 None admin] RBAC: Authorizing `identity:get_group(group_id=987f91380a2042169829096318cd6b55)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:31.594292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807707c-c905-4276-bd53-2841368a3ca5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:31.596493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 207/413] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:31 2022] GET /identity/v3/groups/987f91380a2042169829096318cd6b55 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:31.603729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70533d-7a89-4ce5-a80e-71049d95a679 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:31.739551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70533d-7a89-4ce5-a80e-71049d95a679 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:31.780302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d56084-d6e0-47af-a0f2-4b3ab0bfdfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:31.781381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56084-d6e0-47af-a0f2-4b3ab0bfdfbc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.781668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56084-d6e0-47af-a0f2-4b3ab0bfdfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.781942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d56084-d6e0-47af-a0f2-4b3ab0bfdfbc None admin] PATH_INFO: `/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.783171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d56084-d6e0-47af-a0f2-4b3ab0bfdfbc None admin] RBAC: Authorizing `identity:get_project(project_id=34e93c67d4cd4a79a4295c88eb6ac57a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:31.784674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d56084-d6e0-47af-a0f2-4b3ab0bfdfbc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:31.787490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 207/414] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:31 2022] GET /identity/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:31.793120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807707c-c905-4276-bd53-2841368a3ca5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:31.915452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807707c-c905-4276-bd53-2841368a3ca5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:31.952920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b2b8-ecd9-45e3-9143-9b1a972486bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:31.953816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b2b8-ecd9-45e3-9143-9b1a972486bd None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.954106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b2b8-ecd9-45e3-9143-9b1a972486bd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.954386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4b2b8-ecd9-45e3-9143-9b1a972486bd None admin] PATH_INFO: `/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a/groups/987f91380a2042169829096318cd6b55/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.956462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b2b8-ecd9-45e3-9143-9b1a972486bd None admin] RBAC: Authorizing `identity:create_grant(project_id=34e93c67d4cd4a79a4295c88eb6ac57a, group_id=987f91380a2042169829096318cd6b55, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:31.957995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4b2b8-ecd9-45e3-9143-9b1a972486bd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:31.976901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a9e1-fdbb-456f-9f2c-009875d9acd9 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.977196 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a9e1-fdbb-456f-9f2c-009875d9acd9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.977470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456a9e1-fdbb-456f-9f2c-009875d9acd9 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.979375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 208/415] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:55:31.985133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd6441-d42b-48e0-a2c7-57c3ea554d62 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:31.985427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd6441-d42b-48e0-a2c7-57c3ea554d62 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:31.985707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd6441-d42b-48e0-a2c7-57c3ea554d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:31.993483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:32.005120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4cbd6441-d42b-48e0-a2c7-57c3ea554d62 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:32.006920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4cbd6441-d42b-48e0-a2c7-57c3ea554d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:32.036211 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 208/416] 10.222.0.49 () {58 vars in 1442 bytes} [Tue Jun 28 11:55:31 2022] PUT /identity/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a/groups/987f91380a2042169829096318cd6b55/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:32.105702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 209/417] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:32.146325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b2b8-ecd9-45e3-9143-9b1a972486bd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:32.220828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:32.281967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4b2b8-ecd9-45e3-9143-9b1a972486bd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:32.317915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a7341-db71-4bd0-9bcf-a4f3f7c82832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:32.318785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a7341-db71-4bd0-9bcf-a4f3f7c82832 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:32.319074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a7341-db71-4bd0-9bcf-a4f3f7c82832 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:32.319357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a7341-db71-4bd0-9bcf-a4f3f7c82832 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:32.330008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a7341-db71-4bd0-9bcf-a4f3f7c82832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-456a7341-db71-4bd0-9bcf-a4f3f7c82832 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:32.338261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:32.339213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:32.340033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 209/418] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:32.346068 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd6441-d42b-48e0-a2c7-57c3ea554d62 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:32.484654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8243dbb-d1fb-40a7-a1bd-3b815626e8b7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:32.485001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8243dbb-d1fb-40a7-a1bd-3b815626e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:32.485212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8243dbb-d1fb-40a7-a1bd-3b815626e8b7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:32.486863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 210/419] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:32.491983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edcbe8-2bfd-4f35-81be-c643a47b773b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:32.492280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edcbe8-2bfd-4f35-81be-c643a47b773b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:32.492562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edcbe8-2bfd-4f35-81be-c643a47b773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:32.497109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd6441-d42b-48e0-a2c7-57c3ea554d62 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:32.543593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-80edcbe8-2bfd-4f35-81be-c643a47b773b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:32.544824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-80edcbe8-2bfd-4f35-81be-c643a47b773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:32.550640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6752-c4e4-4f4e-a930-e12a6ad7472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:32.551859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6752-c4e4-4f4e-a930-e12a6ad7472f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:32.551859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6752-c4e4-4f4e-a930-e12a6ad7472f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:32.552499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb6752-c4e4-4f4e-a930-e12a6ad7472f None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:32.553221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb6752-c4e4-4f4e-a930-e12a6ad7472f None admin] RBAC: Adding query filter params (name=member) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:32.553524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb6752-c4e4-4f4e-a930-e12a6ad7472f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:32.554894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb6752-c4e4-4f4e-a930-e12a6ad7472f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:32.556719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:32.572873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 210/420] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:32.578294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6752-c4e4-4f4e-a930-e12a6ad7472f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:32.702297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 211/421] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:32.713128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb6752-c4e4-4f4e-a930-e12a6ad7472f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:32.746799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edcbe8-2bfd-4f35-81be-c643a47b773b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:32.749677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a459602-ec41-4ed3-96ee-97ec940c5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:32.750337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a459602-ec41-4ed3-96ee-97ec940c5c38 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:32.750618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a459602-ec41-4ed3-96ee-97ec940c5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:32.750894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a459602-ec41-4ed3-96ee-97ec940c5c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:32.821539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a459602-ec41-4ed3-96ee-97ec940c5c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:32.823076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a459602-ec41-4ed3-96ee-97ec940c5c38 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:32.825010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:32.855467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:32.929656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 211/422] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:32.936868 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a459602-ec41-4ed3-96ee-97ec940c5c38 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:32.998844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edcbe8-2bfd-4f35-81be-c643a47b773b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:33.060386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:33.069544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a459602-ec41-4ed3-96ee-97ec940c5c38 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:33.089757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a1507-d152-4ee8-b3a0-3ebb53cfac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:33.090571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a1507-d152-4ee8-b3a0-3ebb53cfac91 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.090853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a1507-d152-4ee8-b3a0-3ebb53cfac91 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.091126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a1507-d152-4ee8-b3a0-3ebb53cfac91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.115567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a1507-d152-4ee8-b3a0-3ebb53cfac91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1f5a1507-d152-4ee8-b3a0-3ebb53cfac91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:33.123288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:33.124224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:33.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 212/423] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:33.130769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a1507-d152-4ee8-b3a0-3ebb53cfac91 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:33.181194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aab898-97f5-4c7f-803d-8d5fd488bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:33.182330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aab898-97f5-4c7f-803d-8d5fd488bc52 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.182776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aab898-97f5-4c7f-803d-8d5fd488bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.183197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aab898-97f5-4c7f-803d-8d5fd488bc52 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.184598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aab898-97f5-4c7f-803d-8d5fd488bc52 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:33.186253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aab898-97f5-4c7f-803d-8d5fd488bc52 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:33.188434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 212/424] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:32 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:33.189862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c952ddd-8750-46fb-8fb3-6e4d90674330 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.190370 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c952ddd-8750-46fb-8fb3-6e4d90674330 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.195902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c952ddd-8750-46fb-8fb3-6e4d90674330 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.197844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 213/425] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:33.198870 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c952ddd-8750-46fb-8fb3-6e4d90674330 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:33.252723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:33.261225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a1507-d152-4ee8-b3a0-3ebb53cfac91 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:33.298963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7de9f-a58b-4411-8ca5-daa49f73718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:33.300041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7de9f-a58b-4411-8ca5-daa49f73718f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.300583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7de9f-a58b-4411-8ca5-daa49f73718f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.301786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7de9f-a58b-4411-8ca5-daa49f73718f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.302759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7de9f-a58b-4411-8ca5-daa49f73718f None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:33.303274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7de9f-a58b-4411-8ca5-daa49f73718f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:33.305231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7de9f-a58b-4411-8ca5-daa49f73718f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:33.314779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 213/426] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:55:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:33.317918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538db62b-61e6-4d63-a8dc-9a7428c4dad2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.318437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538db62b-61e6-4d63-a8dc-9a7428c4dad2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.318931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538db62b-61e6-4d63-a8dc-9a7428c4dad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.327039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c952ddd-8750-46fb-8fb3-6e4d90674330 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:33.343620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-538db62b-61e6-4d63-a8dc-9a7428c4dad2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:33.345159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-538db62b-61e6-4d63-a8dc-9a7428c4dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:33.370646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29475796-1a3c-4f7b-b7c0-97e5d5932354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:33.371775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29475796-1a3c-4f7b-b7c0-97e5d5932354 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.372103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29475796-1a3c-4f7b-b7c0-97e5d5932354 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.372385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29475796-1a3c-4f7b-b7c0-97e5d5932354 None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.374276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29475796-1a3c-4f7b-b7c0-97e5d5932354 None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:33.376063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29475796-1a3c-4f7b-b7c0-97e5d5932354 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:33.378406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 214/427] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:33 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:33.379995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29475796-1a3c-4f7b-b7c0-97e5d5932354 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:33.423104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:33.425225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 214/428] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:33.426596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538db62b-61e6-4d63-a8dc-9a7428c4dad2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:33.522244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29475796-1a3c-4f7b-b7c0-97e5d5932354 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:33.530525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:33.545205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538db62b-61e6-4d63-a8dc-9a7428c4dad2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:33.558653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c459b-308e-45f6-87f2-fe2ba25473a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:33.559351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c459b-308e-45f6-87f2-fe2ba25473a1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.559577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c459b-308e-45f6-87f2-fe2ba25473a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.559851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c459b-308e-45f6-87f2-fe2ba25473a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.585850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542dc0-bd43-4625-ab15-3fe3f6de591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:33.587004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542dc0-bd43-4625-ab15-3fe3f6de591e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.587481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542dc0-bd43-4625-ab15-3fe3f6de591e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.587987 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542dc0-bd43-4625-ab15-3fe3f6de591e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.589168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99542dc0-bd43-4625-ab15-3fe3f6de591e None admin] RBAC: Adding query filter params (group.id=d19c16f4fe1b439a8fc36ac6bfda43ec, role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:33.589767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99542dc0-bd43-4625-ab15-3fe3f6de591e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:33.591510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99542dc0-bd43-4625-ab15-3fe3f6de591e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:33.598979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 215/429] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:33 2022] GET /identity/v3/role_assignments?group.id=d19c16f4fe1b439a8fc36ac6bfda43ec&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:33.600302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542dc0-bd43-4625-ab15-3fe3f6de591e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:33.662227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c459b-308e-45f6-87f2-fe2ba25473a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:33.663789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c459b-308e-45f6-87f2-fe2ba25473a1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:33.713832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542dc0-bd43-4625-ab15-3fe3f6de591e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:33.725310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:33.753978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d37a84-1983-482a-a6f3-d238eea6a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:33.755213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d37a84-1983-482a-a6f3-d238eea6a27f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.756497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d37a84-1983-482a-a6f3-d238eea6a27f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.757008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d37a84-1983-482a-a6f3-d238eea6a27f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.769047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d37a84-1983-482a-a6f3-d238eea6a27f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f8d37a84-1983-482a-a6f3-d238eea6a27f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:33.778542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:33.779480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:33.780293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:33.783165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 216/430] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:33.790406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d37a84-1983-482a-a6f3-d238eea6a27f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:33.821438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:33.880541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 215/431] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:33.883894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c459b-308e-45f6-87f2-fe2ba25473a1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:33.935860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d37a84-1983-482a-a6f3-d238eea6a27f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:33.970701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee57b1-4be2-4046-b0f0-a7668e4e541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:33.971657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee57b1-4be2-4046-b0f0-a7668e4e541b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:33.972152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee57b1-4be2-4046-b0f0-a7668e4e541b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:33.972565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee57b1-4be2-4046-b0f0-a7668e4e541b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:33.973542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee57b1-4be2-4046-b0f0-a7668e4e541b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:33.974043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee57b1-4be2-4046-b0f0-a7668e4e541b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:33.975558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee57b1-4be2-4046-b0f0-a7668e4e541b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:33.984699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 217/432] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:33.995005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee57b1-4be2-4046-b0f0-a7668e4e541b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:33.996109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c459b-308e-45f6-87f2-fe2ba25473a1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:34.028559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:34.034834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf42d1-ca4c-4bca-af25-fa1bfb7fdb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:34.036404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf42d1-ca4c-4bca-af25-fa1bfb7fdb67 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.036782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf42d1-ca4c-4bca-af25-fa1bfb7fdb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.037346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf42d1-ca4c-4bca-af25-fa1bfb7fdb67 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.038777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf42d1-ca4c-4bca-af25-fa1bfb7fdb67 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:34.040265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf42d1-ca4c-4bca-af25-fa1bfb7fdb67 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:34.042188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 216/433] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:33 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:34.048432 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf42d1-ca4c-4bca-af25-fa1bfb7fdb67 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:34.087285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:34.114136 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee57b1-4be2-4046-b0f0-a7668e4e541b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:34.155445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27cae8-38fe-4e1e-9729-11ed48f4b72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:34.156263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27cae8-38fe-4e1e-9729-11ed48f4b72c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.156656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27cae8-38fe-4e1e-9729-11ed48f4b72c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.156946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27cae8-38fe-4e1e-9729-11ed48f4b72c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.159425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf42d1-ca4c-4bca-af25-fa1bfb7fdb67 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:34.196084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96271a1e-024b-4d1f-85af-8a0cd2d3df1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:34.198145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96271a1e-024b-4d1f-85af-8a0cd2d3df1f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.198633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96271a1e-024b-4d1f-85af-8a0cd2d3df1f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.199122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96271a1e-024b-4d1f-85af-8a0cd2d3df1f None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.202097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96271a1e-024b-4d1f-85af-8a0cd2d3df1f None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:34.204156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96271a1e-024b-4d1f-85af-8a0cd2d3df1f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:34.206909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 217/434] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:34 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:34.209615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4367b-890b-4851-8120-e6da6260173b None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.210130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4367b-890b-4851-8120-e6da6260173b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.210626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4367b-890b-4851-8120-e6da6260173b None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.212368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 218/435] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:34.213219 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4367b-890b-4851-8120-e6da6260173b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:34.244181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27cae8-38fe-4e1e-9729-11ed48f4b72c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:34.246242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27cae8-38fe-4e1e-9729-11ed48f4b72c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:34.314062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:34.348480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:34.362422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4367b-890b-4851-8120-e6da6260173b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:34.381720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 218/436] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:34.383025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415939f-e49a-4a6a-81d9-696f3d799688 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.383311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415939f-e49a-4a6a-81d9-696f3d799688 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.383611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415939f-e49a-4a6a-81d9-696f3d799688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.404978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0415939f-e49a-4a6a-81d9-696f3d799688 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:34.405183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96f2c7-ee31-40e3-b1f0-46c0d0f52d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:34.405863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96f2c7-ee31-40e3-b1f0-46c0d0f52d9e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.406102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96f2c7-ee31-40e3-b1f0-46c0d0f52d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.406195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0415939f-e49a-4a6a-81d9-696f3d799688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:34.406380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96f2c7-ee31-40e3-b1f0-46c0d0f52d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.407213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96f2c7-ee31-40e3-b1f0-46c0d0f52d9e None admin] RBAC: Adding query filter params (group.id=d19c16f4fe1b439a8fc36ac6bfda43ec, role.id=060d4fd81b0744fd9118c205f3961d49, scope.project.id=a39345b421b846488684793b6a430379) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:34.407519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96f2c7-ee31-40e3-b1f0-46c0d0f52d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:34.409004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96f2c7-ee31-40e3-b1f0-46c0d0f52d9e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:34.415163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 219/437] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:34 2022] GET /identity/v3/role_assignments?group.id=d19c16f4fe1b439a8fc36ac6bfda43ec&scope.project.id=a39345b421b846488684793b6a430379&role.id=060d4fd81b0744fd9118c205f3961d49 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:34.415991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96f2c7-ee31-40e3-b1f0-46c0d0f52d9e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:34.497517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 219/438] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:34.522980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415939f-e49a-4a6a-81d9-696f3d799688 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:34.560838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96f2c7-ee31-40e3-b1f0-46c0d0f52d9e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:34.594497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:34.600145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f023b-e9f6-4b1d-830e-6ab10e708280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:34.601028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f023b-e9f6-4b1d-830e-6ab10e708280 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.601312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f023b-e9f6-4b1d-830e-6ab10e708280 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.601588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f023b-e9f6-4b1d-830e-6ab10e708280 None admin] PATH_INFO: `/v3/projects/9664179425e34ff98312ac1c4cdc1f0a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.603065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f023b-e9f6-4b1d-830e-6ab10e708280 None admin] RBAC: Authorizing `identity:get_project(project_id=9664179425e34ff98312ac1c4cdc1f0a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:34.604569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f023b-e9f6-4b1d-830e-6ab10e708280 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:34.606473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 220/439] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:34 2022] GET /identity/v3/projects/9664179425e34ff98312ac1c4cdc1f0a => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:34.607483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db638-5797-43ff-b883-94b45eb5563d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.608686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db638-5797-43ff-b883-94b45eb5563d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.608686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db638-5797-43ff-b883-94b45eb5563d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.613922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 221/440] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:34.613922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004db638-5797-43ff-b883-94b45eb5563d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:34.644007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415939f-e49a-4a6a-81d9-696f3d799688 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:34.646665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:34.679204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f140444-bac0-4871-9363-998aba506838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:34.680333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f140444-bac0-4871-9363-998aba506838 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.680613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f140444-bac0-4871-9363-998aba506838 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.680886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f140444-bac0-4871-9363-998aba506838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.690691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f140444-bac0-4871-9363-998aba506838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3f140444-bac0-4871-9363-998aba506838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:34.699271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:34.700207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:34.700993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 220/441] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:34.701670 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca1d0-cd00-480e-981d-508b35319d0a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.701871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca1d0-cd00-480e-981d-508b35319d0a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.702206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca1d0-cd00-480e-981d-508b35319d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.717894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f4aca1d0-cd00-480e-981d-508b35319d0a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:34.719060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4aca1d0-cd00-480e-981d-508b35319d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:34.728632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004db638-5797-43ff-b883-94b45eb5563d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:34.762692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb9d9-8ac4-4bf1-9c87-8b359bfd0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:34.763542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb9d9-8ac4-4bf1-9c87-8b359bfd0999 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.763818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb9d9-8ac4-4bf1-9c87-8b359bfd0999 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.764150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb9d9-8ac4-4bf1-9c87-8b359bfd0999 None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.765313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb9d9-8ac4-4bf1-9c87-8b359bfd0999 None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:34.766766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb9d9-8ac4-4bf1-9c87-8b359bfd0999 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:34.768398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 222/442] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:34 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:34.773203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb9d9-8ac4-4bf1-9c87-8b359bfd0999 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:34.786699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 221/443] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:34.787615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aca1d0-cd00-480e-981d-508b35319d0a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:34.841573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:34.875788 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb9d9-8ac4-4bf1-9c87-8b359bfd0999 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:34.887312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:34.893941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aca1d0-cd00-480e-981d-508b35319d0a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:34.909690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ccfc5-9814-4b88-b16c-6a6bdf6e5f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:34.910916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ccfc5-9814-4b88-b16c-6a6bdf6e5f0e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.911253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ccfc5-9814-4b88-b16c-6a6bdf6e5f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.911625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ccfc5-9814-4b88-b16c-6a6bdf6e5f0e None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.912437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ccfc5-9814-4b88-b16c-6a6bdf6e5f0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:34.912744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ccfc5-9814-4b88-b16c-6a6bdf6e5f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:34.914122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ccfc5-9814-4b88-b16c-6a6bdf6e5f0e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:34.921966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 223/444] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:34.922573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ccfc5-9814-4b88-b16c-6a6bdf6e5f0e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:34.932791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e546e-bc6d-4482-993a-3f9c6cd53da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:34.933388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e546e-bc6d-4482-993a-3f9c6cd53da4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:34.933677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e546e-bc6d-4482-993a-3f9c6cd53da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:34.933963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e546e-bc6d-4482-993a-3f9c6cd53da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:34.934803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e546e-bc6d-4482-993a-3f9c6cd53da4 None admin] RBAC: Adding query filter params (group.id=d19c16f4fe1b439a8fc36ac6bfda43ec, role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=9664179425e34ff98312ac1c4cdc1f0a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:34.935120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e546e-bc6d-4482-993a-3f9c6cd53da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:34.936596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e546e-bc6d-4482-993a-3f9c6cd53da4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:34.942529 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 222/445] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:34 2022] GET /identity/v3/role_assignments?group.id=d19c16f4fe1b439a8fc36ac6bfda43ec&scope.project.id=9664179425e34ff98312ac1c4cdc1f0a&role.id=478978f29ae748188de8d1a31490bb00 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:34.943399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e546e-bc6d-4482-993a-3f9c6cd53da4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:35.043050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ccfc5-9814-4b88-b16c-6a6bdf6e5f0e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:35.059936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e546e-bc6d-4482-993a-3f9c6cd53da4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:35.073260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:35.079303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceff4db-f402-4c65-80cf-6377871124db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:35.080208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceff4db-f402-4c65-80cf-6377871124db None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:35.080426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceff4db-f402-4c65-80cf-6377871124db None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:35.080707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceff4db-f402-4c65-80cf-6377871124db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:35.092305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceff4db-f402-4c65-80cf-6377871124db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-fceff4db-f402-4c65-80cf-6377871124db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:35.101684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:35.102837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:35.103641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 224/446] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:55:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:35.104327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdafdf-386d-46e9-990c-12f64a87e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:35.104327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdafdf-386d-46e9-990c-12f64a87e609 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:35.104327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdafdf-386d-46e9-990c-12f64a87e609 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:35.104534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdafdf-386d-46e9-990c-12f64a87e609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:35.107820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceff4db-f402-4c65-80cf-6377871124db None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:35.138430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:35.186136 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdafdf-386d-46e9-990c-12f64a87e609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:35.187533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdafdf-386d-46e9-990c-12f64a87e609 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:35.235941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceff4db-f402-4c65-80cf-6377871124db None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:35.278832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d34ad-e039-4560-b983-d797b693bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:35.279514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d34ad-e039-4560-b983-d797b693bb55 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:35.279803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d34ad-e039-4560-b983-d797b693bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:35.280131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d34ad-e039-4560-b983-d797b693bb55 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:35.280894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d34ad-e039-4560-b983-d797b693bb55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:35.281210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d34ad-e039-4560-b983-d797b693bb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:35.282600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d34ad-e039-4560-b983-d797b693bb55 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:35.295526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 225/447] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:35.300007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d34ad-e039-4560-b983-d797b693bb55 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:35.305715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 223/448] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:35.311320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdafdf-386d-46e9-990c-12f64a87e609 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:35.361646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:35.380601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:35.419557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d34ad-e039-4560-b983-d797b693bb55 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:35.432576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdafdf-386d-46e9-990c-12f64a87e609 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:35.464070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c8893-8192-4a9f-abd2-113fe5ec47c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:35.464651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c8893-8192-4a9f-abd2-113fe5ec47c8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:35.464934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c8893-8192-4a9f-abd2-113fe5ec47c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:35.465211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c8893-8192-4a9f-abd2-113fe5ec47c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:35.476343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab49a87-db2a-4ce5-8653-4d14785d6417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:35.477207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab49a87-db2a-4ce5-8653-4d14785d6417 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:35.477743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab49a87-db2a-4ce5-8653-4d14785d6417 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:35.478038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab49a87-db2a-4ce5-8653-4d14785d6417 None admin] PATH_INFO: `/v3/projects/a39345b421b846488684793b6a430379` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:35.479233 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab49a87-db2a-4ce5-8653-4d14785d6417 None admin] RBAC: Authorizing `identity:get_project(project_id=a39345b421b846488684793b6a430379)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:35.480729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab49a87-db2a-4ce5-8653-4d14785d6417 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:35.482438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 224/449] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:35 2022] GET /identity/v3/projects/a39345b421b846488684793b6a430379 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:35.487718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab49a87-db2a-4ce5-8653-4d14785d6417 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:35.534949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c8893-8192-4a9f-abd2-113fe5ec47c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:35.536779 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c8893-8192-4a9f-abd2-113fe5ec47c8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:35.587659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:35.592002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab49a87-db2a-4ce5-8653-4d14785d6417 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:35.616804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:35.624778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b589b-8a6a-4066-8c20-89fac7949200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:35.625631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b589b-8a6a-4066-8c20-89fac7949200 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:35.625913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b589b-8a6a-4066-8c20-89fac7949200 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:35.626188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b589b-8a6a-4066-8c20-89fac7949200 None admin] PATH_INFO: `/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:35.627357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b589b-8a6a-4066-8c20-89fac7949200 None admin] RBAC: Authorizing `identity:get_group(group_id=d19c16f4fe1b439a8fc36ac6bfda43ec)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:35.628807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b589b-8a6a-4066-8c20-89fac7949200 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:35.631131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 225/450] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:35 2022] GET /identity/v3/groups/d19c16f4fe1b439a8fc36ac6bfda43ec => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:35.640542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 226/451] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 11:55:35.640689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b589b-8a6a-4066-8c20-89fac7949200 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:35.641911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c8893-8192-4a9f-abd2-113fe5ec47c8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:35.739089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b589b-8a6a-4066-8c20-89fac7949200 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:35.739296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c8893-8192-4a9f-abd2-113fe5ec47c8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:35.772993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4432b-bd89-467a-bcd3-d2e298804c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:35.773156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f068a-078e-40af-886f-6f48d9ab9814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:35.773742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f068a-078e-40af-886f-6f48d9ab9814 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:35.773861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4432b-bd89-467a-bcd3-d2e298804c1a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:35.774031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f068a-078e-40af-886f-6f48d9ab9814 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:35.774119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4432b-bd89-467a-bcd3-d2e298804c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:35.774310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f068a-078e-40af-886f-6f48d9ab9814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:35.774394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4432b-bd89-467a-bcd3-d2e298804c1a None admin] PATH_INFO: `/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:35.775152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f068a-078e-40af-886f-6f48d9ab9814 None admin] RBAC: Adding query filter params (group.id=d19c16f4fe1b439a8fc36ac6bfda43ec, role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=a39345b421b846488684793b6a430379) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:35.775465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f068a-078e-40af-886f-6f48d9ab9814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:35.775549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4432b-bd89-467a-bcd3-d2e298804c1a None admin] RBAC: Authorizing `identity:get_project(project_id=34e93c67d4cd4a79a4295c88eb6ac57a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:35.776945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f068a-078e-40af-886f-6f48d9ab9814 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:35.777035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4432b-bd89-467a-bcd3-d2e298804c1a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:35.778643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 227/452] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:55:35 2022] GET /identity/v3/projects/34e93c67d4cd4a79a4295c88eb6ac57a => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:35.783065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 226/453] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:35 2022] GET /identity/v3/role_assignments?group.id=d19c16f4fe1b439a8fc36ac6bfda43ec&scope.project.id=a39345b421b846488684793b6a430379&role.id=478978f29ae748188de8d1a31490bb00 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:35.784093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4432b-bd89-467a-bcd3-d2e298804c1a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:35.807709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:35.889667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4432b-bd89-467a-bcd3-d2e298804c1a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:35.925338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a5c4-50a9-4435-a84f-b28ef2cefad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:35.926290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a5c4-50a9-4435-a84f-b28ef2cefad0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:35.926600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a5c4-50a9-4435-a84f-b28ef2cefad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:35.926874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a5c4-50a9-4435-a84f-b28ef2cefad0 None admin] PATH_INFO: `/v3/groups/987f91380a2042169829096318cd6b55` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:35.928108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a5c4-50a9-4435-a84f-b28ef2cefad0 None admin] RBAC: Authorizing `identity:get_group(group_id=987f91380a2042169829096318cd6b55)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:35.929575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a5c4-50a9-4435-a84f-b28ef2cefad0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:35.931352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 228/454] 10.222.0.49 () {56 vars in 1180 bytes} [Tue Jun 28 11:55:35 2022] GET /identity/v3/groups/987f91380a2042169829096318cd6b55 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:35.937075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f068a-078e-40af-886f-6f48d9ab9814 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:35.997177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:36.041970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f068a-078e-40af-886f-6f48d9ab9814 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:36.075012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b4cd7-ec8a-4e63-b14e-7809000df3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:36.075664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b4cd7-ec8a-4e63-b14e-7809000df3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:36.075985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b4cd7-ec8a-4e63-b14e-7809000df3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:36.076264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b4cd7-ec8a-4e63-b14e-7809000df3d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:36.077096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b4cd7-ec8a-4e63-b14e-7809000df3d4 None admin] RBAC: Adding query filter params (group.id=987f91380a2042169829096318cd6b55, role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=34e93c67d4cd4a79a4295c88eb6ac57a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:36.077437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b4cd7-ec8a-4e63-b14e-7809000df3d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:36.078859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b4cd7-ec8a-4e63-b14e-7809000df3d4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:36.085254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 227/455] 10.222.0.49 () {56 vars in 1376 bytes} [Tue Jun 28 11:55:35 2022] GET /identity/v3/role_assignments?group.id=987f91380a2042169829096318cd6b55&scope.project.id=34e93c67d4cd4a79a4295c88eb6ac57a&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:38.496509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e764c-ed87-45eb-93e0-95a325d5b8ad None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:38.497546 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e764c-ed87-45eb-93e0-95a325d5b8ad None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:38.498029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e764c-ed87-45eb-93e0-95a325d5b8ad None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:38.499886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 229/456] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:38.508674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e79dd0-b7a5-4df4-917c-8900fb69c6ad None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:38.509584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e79dd0-b7a5-4df4-917c-8900fb69c6ad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:38.510086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e79dd0-b7a5-4df4-917c-8900fb69c6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:38.536998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c3e79dd0-b7a5-4df4-917c-8900fb69c6ad None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:38.538227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3e79dd0-b7a5-4df4-917c-8900fb69c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:38.637957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 228/457] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:38.679268 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e764c-ed87-45eb-93e0-95a325d5b8ad None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:38.716181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a68f3-32c6-456c-ab4e-dd7d8a0fcfd5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:38.716721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a68f3-32c6-456c-ab4e-dd7d8a0fcfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:38.717143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a68f3-32c6-456c-ab4e-dd7d8a0fcfd5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:38.718911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 229/458] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:55:38.724382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6cfaa-aaae-4e0b-b605-194765484300 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:38.725632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6cfaa-aaae-4e0b-b605-194765484300 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:38.726246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6cfaa-aaae-4e0b-b605-194765484300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:38.763982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2cf6cfaa-aaae-4e0b-b605-194765484300 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:38.763982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2cf6cfaa-aaae-4e0b-b605-194765484300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:38.844247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:38.860232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:38.865709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e764c-ed87-45eb-93e0-95a325d5b8ad None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:38.897263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 230/459] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:38.916508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76f4d2-9bb4-4049-9983-55b7f5423451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:38.917533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76f4d2-9bb4-4049-9983-55b7f5423451 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:38.917953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76f4d2-9bb4-4049-9983-55b7f5423451 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:38.918390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76f4d2-9bb4-4049-9983-55b7f5423451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:38.929123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76f4d2-9bb4-4049-9983-55b7f5423451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:38.930741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76f4d2-9bb4-4049-9983-55b7f5423451 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:38.941799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6cfaa-aaae-4e0b-b605-194765484300 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0a76f4d2-9bb4-4049-9983-55b7f5423451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:38.962676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:38.963762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:38.964805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:38.964805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:38.964805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:38.964805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:38.976069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 230/460] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:38.978761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76f4d2-9bb4-4049-9983-55b7f5423451 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:39.112501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76f4d2-9bb4-4049-9983-55b7f5423451 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:39.131325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6cfaa-aaae-4e0b-b605-194765484300 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:39.149947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d63734-405e-4606-96c2-21c980cbb42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:39.150945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63734-405e-4606-96c2-21c980cbb42c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.151460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63734-405e-4606-96c2-21c980cbb42c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.151982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d63734-405e-4606-96c2-21c980cbb42c None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.152948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d63734-405e-4606-96c2-21c980cbb42c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:39.153447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d63734-405e-4606-96c2-21c980cbb42c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:39.155028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d63734-405e-4606-96c2-21c980cbb42c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:39.165148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:39.171919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 231/461] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:39.171919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee7970-b94e-4159-92fb-e5b6eb8b0e00 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.171919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee7970-b94e-4159-92fb-e5b6eb8b0e00 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.171919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee7970-b94e-4159-92fb-e5b6eb8b0e00 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.172437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 232/462] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:39.173761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057df81-0806-41e6-83c2-e67825adaed7 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.173761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057df81-0806-41e6-83c2-e67825adaed7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.173936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057df81-0806-41e6-83c2-e67825adaed7 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.177287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 233/463] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:39.177287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057df81-0806-41e6-83c2-e67825adaed7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:39.182142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b19d9-e2d5-4c09-9c1f-633db6a53d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:39.182563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b19d9-e2d5-4c09-9c1f-633db6a53d3d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.182912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b19d9-e2d5-4c09-9c1f-633db6a53d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.183254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b19d9-e2d5-4c09-9c1f-633db6a53d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.195605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b19d9-e2d5-4c09-9c1f-633db6a53d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:39.197528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b19d9-e2d5-4c09-9c1f-633db6a53d3d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d39b19d9-e2d5-4c09-9c1f-633db6a53d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:39.221248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:39.222157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:39.223695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:39.223695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:39.223695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:39.223695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:39.224515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 231/464] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:39.225389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70efb-9579-4c71-8848-2692618f7549 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.225672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70efb-9579-4c71-8848-2692618f7549 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.225979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70efb-9579-4c71-8848-2692618f7549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.243392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9cb70efb-9579-4c71-8848-2692618f7549 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:39.244598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9cb70efb-9579-4c71-8848-2692618f7549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:39.271653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:39.296445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057df81-0806-41e6-83c2-e67825adaed7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:39.318942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 232/465] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:39.318942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f468e6b-c976-4c36-88d0-5f882dbc3c76 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.318942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f468e6b-c976-4c36-88d0-5f882dbc3c76 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.318942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f468e6b-c976-4c36-88d0-5f882dbc3c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.330799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0f468e6b-c976-4c36-88d0-5f882dbc3c76 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:39.332683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f468e6b-c976-4c36-88d0-5f882dbc3c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:39.338121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fafca4-210d-4cf4-a974-a875e747a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:39.338893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fafca4-210d-4cf4-a974-a875e747a419 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.339259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fafca4-210d-4cf4-a974-a875e747a419 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.339627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fafca4-210d-4cf4-a974-a875e747a419 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.340718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fafca4-210d-4cf4-a974-a875e747a419 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:39.342052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fafca4-210d-4cf4-a974-a875e747a419 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:39.402545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 233/466] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:39.403758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f468e6b-c976-4c36-88d0-5f882dbc3c76 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:39.455477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 234/467] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:55:39 2022] POST /identity/v3/users => generated 246 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:55:39.455477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fafca4-210d-4cf4-a974-a875e747a419 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:39.525297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:39.535580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:39.542534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f468e6b-c976-4c36-88d0-5f882dbc3c76 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:39.580026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fafca4-210d-4cf4-a974-a875e747a419 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:39.592097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbe619-2a91-4d99-b714-6aeb3e614c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:39.593531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbe619-2a91-4d99-b714-6aeb3e614c76 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.593827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbe619-2a91-4d99-b714-6aeb3e614c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.594111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbe619-2a91-4d99-b714-6aeb3e614c76 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.594865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbe619-2a91-4d99-b714-6aeb3e614c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:39.597415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbe619-2a91-4d99-b714-6aeb3e614c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:39.597415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbe619-2a91-4d99-b714-6aeb3e614c76 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:39.619152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 234/468] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:39.619152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbe619-2a91-4d99-b714-6aeb3e614c76 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:39.627035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44546139-3d0e-4053-a49a-44128621f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:39.627933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44546139-3d0e-4053-a49a-44128621f05a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.628213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44546139-3d0e-4053-a49a-44128621f05a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.628492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44546139-3d0e-4053-a49a-44128621f05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.641900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44546139-3d0e-4053-a49a-44128621f05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:39.643400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44546139-3d0e-4053-a49a-44128621f05a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-44546139-3d0e-4053-a49a-44128621f05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:39.665275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:39.666137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:39.666985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:39.666985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:39.666985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:39.666985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:39.668624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 235/469] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:39.669524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44546139-3d0e-4053-a49a-44128621f05a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:39.751714 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbe619-2a91-4d99-b714-6aeb3e614c76 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:39.791797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c6cac-4474-4d10-ba19-d2ebe6899868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:39.792623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c6cac-4474-4d10-ba19-d2ebe6899868 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.792907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c6cac-4474-4d10-ba19-d2ebe6899868 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.793186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c6cac-4474-4d10-ba19-d2ebe6899868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.796103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44546139-3d0e-4053-a49a-44128621f05a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:39.804992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c6cac-4474-4d10-ba19-d2ebe6899868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:39.806305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:39.808112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c6cac-4474-4d10-ba19-d2ebe6899868 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-af4c6cac-4474-4d10-ba19-d2ebe6899868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:39.826324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:39.827454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:39.828519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:39.828519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:39.828519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:39.828519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:39.830380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 235/470] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:39.831371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c6cac-4474-4d10-ba19-d2ebe6899868 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:39.841650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75c947-7dd3-410e-b834-e9a78729720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:39.842464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c947-7dd3-410e-b834-e9a78729720e None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.842876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c947-7dd3-410e-b834-e9a78729720e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.843243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c947-7dd3-410e-b834-e9a78729720e None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.844069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75c947-7dd3-410e-b834-e9a78729720e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:39.846401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:39.846534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75c947-7dd3-410e-b834-e9a78729720e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:39.943826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c6cac-4474-4d10-ba19-d2ebe6899868 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:39.978247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbedd75-ffa7-49a7-a816-908935728c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:39.979138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbedd75-ffa7-49a7-a816-908935728c21 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:39.979563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbedd75-ffa7-49a7-a816-908935728c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:39.980041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbedd75-ffa7-49a7-a816-908935728c21 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:39.980896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbedd75-ffa7-49a7-a816-908935728c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:39.981344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbedd75-ffa7-49a7-a816-908935728c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:39.982957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbedd75-ffa7-49a7-a816-908935728c21 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:39.995670 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 236/471] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:39.996782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbedd75-ffa7-49a7-a816-908935728c21 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:40.009441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 236/472] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:55:39 2022] POST /identity/v3/users => generated 248 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:55:40.012698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75c947-7dd3-410e-b834-e9a78729720e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:40.140910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:40.174583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75c947-7dd3-410e-b834-e9a78729720e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:40.201320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbedd75-ffa7-49a7-a816-908935728c21 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:40.220485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923d2f9-b492-438a-9795-d620696378d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:40.221166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923d2f9-b492-438a-9795-d620696378d3 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:40.221448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923d2f9-b492-438a-9795-d620696378d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:40.221733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923d2f9-b492-438a-9795-d620696378d3 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:40.222451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923d2f9-b492-438a-9795-d620696378d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:40.224025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923d2f9-b492-438a-9795-d620696378d3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:40.245718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15051318-e463-4a80-af3f-ced9e843bee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:40.246406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051318-e463-4a80-af3f-ced9e843bee0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:40.246819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051318-e463-4a80-af3f-ced9e843bee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:40.247092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051318-e463-4a80-af3f-ced9e843bee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:40.247818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15051318-e463-4a80-af3f-ced9e843bee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:40.248172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15051318-e463-4a80-af3f-ced9e843bee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:40.249537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15051318-e463-4a80-af3f-ced9e843bee0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:40.263921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 237/473] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:40.265236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33793cf8-3f09-4e25-9ffe-77bbdb9f74d9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:40.265526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33793cf8-3f09-4e25-9ffe-77bbdb9f74d9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:40.265859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33793cf8-3f09-4e25-9ffe-77bbdb9f74d9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:40.267241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 238/474] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:40.270504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33793cf8-3f09-4e25-9ffe-77bbdb9f74d9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:40.330684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 237/475] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:55:40 2022] POST /identity/v3/users => generated 249 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:55:40.337355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28a6ad-3ca4-4b86-8b67-a885a5767aaf None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:40.338114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28a6ad-3ca4-4b86-8b67-a885a5767aaf None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:40.338743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28a6ad-3ca4-4b86-8b67-a885a5767aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:40.373130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4d28a6ad-3ca4-4b86-8b67-a885a5767aaf None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:40.380751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4d28a6ad-3ca4-4b86-8b67-a885a5767aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:40.412808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:40.444364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33793cf8-3f09-4e25-9ffe-77bbdb9f74d9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:40.509502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:40.513971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 238/476] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:40.534559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b8e1-b2a9-49c0-876a-75e695ffe8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:40.535912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b8e1-b2a9-49c0-876a-75e695ffe8a1 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:40.536189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b8e1-b2a9-49c0-876a-75e695ffe8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:40.536720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b8e1-b2a9-49c0-876a-75e695ffe8a1 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:40.537184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b8e1-b2a9-49c0-876a-75e695ffe8a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:40.538664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b8e1-b2a9-49c0-876a-75e695ffe8a1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:40.549617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28a6ad-3ca4-4b86-8b67-a885a5767aaf None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:40.658740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 239/477] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:55:40 2022] POST /identity/v3/users => generated 248 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 11:55:40.663432 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28a6ad-3ca4-4b86-8b67-a885a5767aaf None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:40.702637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:40.703322 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:40.703602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:40.703898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:40.704681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:40.706211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:40.753514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.sql.core [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 28 11:55:40.753514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 28 11:55:40.753514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [parameters: {'id': '805b468fa88a48bd9fb3b4b61e5cced1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 28 11:55:40.753514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80314) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application conn.query(q) Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application result.read() Jun 28 11:55:40.772077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return ref.to_dict() Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 11:55:40.772972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application next(self.gen) Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application yield resource Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application next(self.gen) Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.session.rollback() Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.force_reraise() Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise self.value Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application session.commit() Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 28 11:55:40.773872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._prepare_impl() Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.session.flush() Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._flush(objects) Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application compat.raise_( Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application flush_context.execute() Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rec.execute(self) Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 28 11:55:40.774747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 11:55:40.775614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application conn.query(q) Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application result.read() Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 11:55:40.778020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [parameters: {'id': '805b468fa88a48bd9fb3b4b61e5cced1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:40.780085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 28 11:55:40.782018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:40.788083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 239/478] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Jun 28 11:55:40 2022] POST /identity/v3/roles => generated 144 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:40.788253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b8e1-b2a9-49c0-876a-75e695ffe8a1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:40.930669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b8e1-b2a9-49c0-876a-75e695ffe8a1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:40.971115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1228e64-45a8-4235-9723-21c37bd749c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:40.971858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1228e64-45a8-4235-9723-21c37bd749c0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:40.972181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1228e64-45a8-4235-9723-21c37bd749c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:40.972989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1228e64-45a8-4235-9723-21c37bd749c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:40.984109 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1228e64-45a8-4235-9723-21c37bd749c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d1228e64-45a8-4235-9723-21c37bd749c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:40.992922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:40.994945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:40.997089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 240/479] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:55:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:41.000906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:41.023276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:41.117938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c420f54-e59e-49ed-a080-8d7e250b7a4d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:41.156959 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d6bb7-eb10-4503-88aa-5b3522ded700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:41.157978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d6bb7-eb10-4503-88aa-5b3522ded700 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:41.158465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d6bb7-eb10-4503-88aa-5b3522ded700 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:41.158943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d6bb7-eb10-4503-88aa-5b3522ded700 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:41.159990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d6bb7-eb10-4503-88aa-5b3522ded700 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:41.161559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d6bb7-eb10-4503-88aa-5b3522ded700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:41.163157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d6bb7-eb10-4503-88aa-5b3522ded700 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:41.176479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 240/480] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:41.861720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826c783-7170-4c24-8ca0-777b1d9fb214 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:41.862710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826c783-7170-4c24-8ca0-777b1d9fb214 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:41.863831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826c783-7170-4c24-8ca0-777b1d9fb214 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:41.866345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 241/481] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:41.871286 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccd78f-a565-4987-a409-82b131c56ec5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:41.871720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccd78f-a565-4987-a409-82b131c56ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:41.871819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccd78f-a565-4987-a409-82b131c56ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:41.890826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-55ccd78f-a565-4987-a409-82b131c56ec5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:41.892040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-55ccd78f-a565-4987-a409-82b131c56ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:41.973671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 241/482] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:42.013668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826c783-7170-4c24-8ca0-777b1d9fb214 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:42.073820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:42.146241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826c783-7170-4c24-8ca0-777b1d9fb214 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:42.191498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d72e2-481c-479f-81df-7407973a6090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:42.192205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d72e2-481c-479f-81df-7407973a6090 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:42.192494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d72e2-481c-479f-81df-7407973a6090 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:42.192766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d72e2-481c-479f-81df-7407973a6090 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:42.203431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d72e2-481c-479f-81df-7407973a6090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b91d72e2-481c-479f-81df-7407973a6090 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:42.216576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:42.217572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:42.218348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 242/483] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:42.226115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccd78f-a565-4987-a409-82b131c56ec5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:42.235063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:42.390674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccd78f-a565-4987-a409-82b131c56ec5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:42.439431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945406f3-2a8c-4877-bbd9-cc7bad303fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:42.440074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945406f3-2a8c-4877-bbd9-cc7bad303fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:42.440361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945406f3-2a8c-4877-bbd9-cc7bad303fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:42.440640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945406f3-2a8c-4877-bbd9-cc7bad303fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:42.441933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945406f3-2a8c-4877-bbd9-cc7bad303fc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:42.442246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945406f3-2a8c-4877-bbd9-cc7bad303fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:42.443638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945406f3-2a8c-4877-bbd9-cc7bad303fc5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:42.455772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 242/484] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:42.461929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d72e2-481c-479f-81df-7407973a6090 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:42.619197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe664d4-ba4d-476d-8f67-7a1786e6c1f1 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:42.619778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe664d4-ba4d-476d-8f67-7a1786e6c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:42.620285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe664d4-ba4d-476d-8f67-7a1786e6c1f1 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:42.622871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 243/485] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:42.629715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852aa20-1ebf-4304-9ae8-af8c8a9371c5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:42.630096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d72e2-481c-479f-81df-7407973a6090 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:42.630441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852aa20-1ebf-4304-9ae8-af8c8a9371c5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:42.630902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852aa20-1ebf-4304-9ae8-af8c8a9371c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:42.644189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:42.673177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4852aa20-1ebf-4304-9ae8-af8c8a9371c5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:42.674360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4852aa20-1ebf-4304-9ae8-af8c8a9371c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:42.677453 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777078-95b3-41a5-8675-0910173da518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:42.678272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777078-95b3-41a5-8675-0910173da518 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:42.678551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777078-95b3-41a5-8675-0910173da518 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:42.678821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56777078-95b3-41a5-8675-0910173da518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:42.702592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56777078-95b3-41a5-8675-0910173da518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:42.704062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56777078-95b3-41a5-8675-0910173da518 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-56777078-95b3-41a5-8675-0910173da518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:42.739558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:42.740483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:42.741292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:42.741292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:42.741292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:42.741292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:42.741292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 243/486] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:42.747284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777078-95b3-41a5-8675-0910173da518 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:42.816294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:42.824187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 244/487] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:42.860173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852aa20-1ebf-4304-9ae8-af8c8a9371c5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:42.945337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56777078-95b3-41a5-8675-0910173da518 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.018928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852aa20-1ebf-4304-9ae8-af8c8a9371c5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.056469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22712122-5048-40c0-a457-da8a028b266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.057651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22712122-5048-40c0-a457-da8a028b266c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.057934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22712122-5048-40c0-a457-da8a028b266c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.058208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22712122-5048-40c0-a457-da8a028b266c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.062650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c75ea-3d40-4c00-9823-4795651a61ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.063315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c75ea-3d40-4c00-9823-4795651a61ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.063596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c75ea-3d40-4c00-9823-4795651a61ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.063880 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c75ea-3d40-4c00-9823-4795651a61ba None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.064611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c75ea-3d40-4c00-9823-4795651a61ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:43.064918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c75ea-3d40-4c00-9823-4795651a61ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:43.066335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c75ea-3d40-4c00-9823-4795651a61ba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:43.077780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22712122-5048-40c0-a457-da8a028b266c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-22712122-5048-40c0-a457-da8a028b266c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:43.086069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:43.086947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:43.087722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:43.088375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 244/488] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:43.088375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502105f-5316-49fc-9626-3322f5be549d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.088505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502105f-5316-49fc-9626-3322f5be549d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.089069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502105f-5316-49fc-9626-3322f5be549d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.094040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 245/489] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:43.096024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 245/490] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:43.096969 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502105f-5316-49fc-9626-3322f5be549d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:43.097149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22712122-5048-40c0-a457-da8a028b266c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:43.152248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:43.158379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:43.202506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22712122-5048-40c0-a457-da8a028b266c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.213405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502105f-5316-49fc-9626-3322f5be549d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.240040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdadf6-7901-4b33-af10-3686c65dfdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.240805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdadf6-7901-4b33-af10-3686c65dfdae None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.241159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdadf6-7901-4b33-af10-3686c65dfdae None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.241505 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdadf6-7901-4b33-af10-3686c65dfdae None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.242326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdadf6-7901-4b33-af10-3686c65dfdae None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:43.242708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdadf6-7901-4b33-af10-3686c65dfdae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:43.244237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdadf6-7901-4b33-af10-3686c65dfdae None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:43.252920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 246/491] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:43.259090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469efd35-1b20-45d2-9b1f-1bd01a7d3d51 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.259464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469efd35-1b20-45d2-9b1f-1bd01a7d3d51 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.259808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469efd35-1b20-45d2-9b1f-1bd01a7d3d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.261096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec442bd6-e62d-4a63-8ac2-826f6f91864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.262154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442bd6-e62d-4a63-8ac2-826f6f91864b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.262678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442bd6-e62d-4a63-8ac2-826f6f91864b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.263104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec442bd6-e62d-4a63-8ac2-826f6f91864b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.273486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec442bd6-e62d-4a63-8ac2-826f6f91864b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:43.275449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec442bd6-e62d-4a63-8ac2-826f6f91864b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:43.278700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-469efd35-1b20-45d2-9b1f-1bd01a7d3d51 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:43.280024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-469efd35-1b20-45d2-9b1f-1bd01a7d3d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ec442bd6-e62d-4a63-8ac2-826f6f91864b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:43.296314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:43.297438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:55:43.298542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:43.302479 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 246/492] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Jun 28 11:55:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:43.303589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec442bd6-e62d-4a63-8ac2-826f6f91864b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:43.367965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 247/493] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:43.367965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469efd35-1b20-45d2-9b1f-1bd01a7d3d51 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:43.420975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:43.437251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:43.445951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec442bd6-e62d-4a63-8ac2-826f6f91864b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.481427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2e455-fa75-4a64-8b67-24844ca6f71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.482251 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2e455-fa75-4a64-8b67-24844ca6f71d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.482537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2e455-fa75-4a64-8b67-24844ca6f71d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.482813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2e455-fa75-4a64-8b67-24844ca6f71d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.490690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469efd35-1b20-45d2-9b1f-1bd01a7d3d51 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.493490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2e455-fa75-4a64-8b67-24844ca6f71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:43.494953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2e455-fa75-4a64-8b67-24844ca6f71d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-abd2e455-fa75-4a64-8b67-24844ca6f71d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:43.517278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:43.518203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:43.519007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:43.519007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:43.519007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:43.519007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:43.519007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 247/494] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:43.524827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2e455-fa75-4a64-8b67-24844ca6f71d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:43.539808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64428247-f67c-4071-b706-40d77d9c8440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.540523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428247-f67c-4071-b706-40d77d9c8440 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.540806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428247-f67c-4071-b706-40d77d9c8440 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.541085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64428247-f67c-4071-b706-40d77d9c8440 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.541939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64428247-f67c-4071-b706-40d77d9c8440 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:43.542242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64428247-f67c-4071-b706-40d77d9c8440 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:43.543693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64428247-f67c-4071-b706-40d77d9c8440 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:43.580851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 248/495] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Jun 28 11:55:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:43.582771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b4e03-782c-4cce-9275-786e53ef5bd4 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.583058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b4e03-782c-4cce-9275-786e53ef5bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.583334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b4e03-782c-4cce-9275-786e53ef5bd4 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.584761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 249/496] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:43.585351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b4e03-782c-4cce-9275-786e53ef5bd4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:43.641399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2e455-fa75-4a64-8b67-24844ca6f71d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.669067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:43.677592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccee35-63e3-4b7c-88b9-634b1e8116f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.678580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccee35-63e3-4b7c-88b9-634b1e8116f1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.685171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccee35-63e3-4b7c-88b9-634b1e8116f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.685171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deccee35-63e3-4b7c-88b9-634b1e8116f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.689332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deccee35-63e3-4b7c-88b9-634b1e8116f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-deccee35-63e3-4b7c-88b9-634b1e8116f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:43.697460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:43.698544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:43.699362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:43.700449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 248/497] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:43.701042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccee35-63e3-4b7c-88b9-634b1e8116f1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:43.704489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b4e03-782c-4cce-9275-786e53ef5bd4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.715565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:43.741348 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ce02c-9eba-4bdb-91bd-19a6b7868772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.742101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ce02c-9eba-4bdb-91bd-19a6b7868772 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.742386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ce02c-9eba-4bdb-91bd-19a6b7868772 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.742658 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ce02c-9eba-4bdb-91bd-19a6b7868772 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.743386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ce02c-9eba-4bdb-91bd-19a6b7868772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:43.743693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ce02c-9eba-4bdb-91bd-19a6b7868772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:43.745220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ce02c-9eba-4bdb-91bd-19a6b7868772 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:43.761703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 250/498] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:43.761703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8686-64ce-4fa6-9256-815a49505294 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.761703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8686-64ce-4fa6-9256-815a49505294 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.761703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8686-64ce-4fa6-9256-815a49505294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.776451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b42a8686-64ce-4fa6-9256-815a49505294 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:43.777564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b42a8686-64ce-4fa6-9256-815a49505294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:43.813620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deccee35-63e3-4b7c-88b9-634b1e8116f1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.842701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 251/499] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:43.843517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a8686-64ce-4fa6-9256-815a49505294 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:43.849090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15655c2f-4c72-495d-9036-910d15428f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.849736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655c2f-4c72-495d-9036-910d15428f86 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.850019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655c2f-4c72-495d-9036-910d15428f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.850298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15655c2f-4c72-495d-9036-910d15428f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.904976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:43.918246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15655c2f-4c72-495d-9036-910d15428f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:43.919705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15655c2f-4c72-495d-9036-910d15428f86 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:43.953689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:43.957519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a8686-64ce-4fa6-9256-815a49505294 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:43.991654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ed74f-a169-4173-80d8-de1c3a4f41fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:43.992350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ed74f-a169-4173-80d8-de1c3a4f41fb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:43.992632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ed74f-a169-4173-80d8-de1c3a4f41fb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:43.992908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ed74f-a169-4173-80d8-de1c3a4f41fb None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:43.993656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ed74f-a169-4173-80d8-de1c3a4f41fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:43.994051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ed74f-a169-4173-80d8-de1c3a4f41fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:43.995438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ed74f-a169-4173-80d8-de1c3a4f41fb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.003162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 252/500] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:44.003998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ed74f-a169-4173-80d8-de1c3a4f41fb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.023074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 249/501] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:44.023074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f162698-2567-4b82-affe-70274cd9974c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.023074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f162698-2567-4b82-affe-70274cd9974c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.023074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f162698-2567-4b82-affe-70274cd9974c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.023074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 250/502] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:44.023074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f162698-2567-4b82-affe-70274cd9974c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.105018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ed74f-a169-4173-80d8-de1c3a4f41fb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.106915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:44.122501 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f162698-2567-4b82-affe-70274cd9974c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.138191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68734d-23f0-432c-adae-14cd2d196430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.138984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68734d-23f0-432c-adae-14cd2d196430 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.139262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68734d-23f0-432c-adae-14cd2d196430 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.139540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68734d-23f0-432c-adae-14cd2d196430 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.148753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68734d-23f0-432c-adae-14cd2d196430 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:44.150296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68734d-23f0-432c-adae-14cd2d196430 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.156285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d39e23-b43a-45d4-a0a1-b968c93777dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.157073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d39e23-b43a-45d4-a0a1-b968c93777dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.157357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d39e23-b43a-45d4-a0a1-b968c93777dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.157634 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d39e23-b43a-45d4-a0a1-b968c93777dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5a68734d-23f0-432c-adae-14cd2d196430 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:44.165988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:44.167031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:44.167983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 253/503] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:44.168525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68734d-23f0-432c-adae-14cd2d196430 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.168857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d39e23-b43a-45d4-a0a1-b968c93777dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-62d39e23-b43a-45d4-a0a1-b968c93777dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:44.177079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:44.178047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:44.179038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 251/504] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:44.179697 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d39e23-b43a-45d4-a0a1-b968c93777dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.194320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:44.270533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68734d-23f0-432c-adae-14cd2d196430 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.278365 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d39e23-b43a-45d4-a0a1-b968c93777dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.303968 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e6ae7-46d2-40bd-bd66-797cd35cd9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.304755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e6ae7-46d2-40bd-bd66-797cd35cd9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.305036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e6ae7-46d2-40bd-bd66-797cd35cd9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.305307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e6ae7-46d2-40bd-bd66-797cd35cd9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.311419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee11f7b-965c-43f1-899c-745bedaa54b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.312643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee11f7b-965c-43f1-899c-745bedaa54b5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.312933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee11f7b-965c-43f1-899c-745bedaa54b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.313215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee11f7b-965c-43f1-899c-745bedaa54b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.315579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e6ae7-46d2-40bd-bd66-797cd35cd9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:44.317099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e6ae7-46d2-40bd-bd66-797cd35cd9e4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.324039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee11f7b-965c-43f1-899c-745bedaa54b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:44.325504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee11f7b-965c-43f1-899c-745bedaa54b5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.331629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-1f7e6ae7-46d2-40bd-bd66-797cd35cd9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:44.334271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:44.335073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:44.336271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:44.336271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:44.336271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:44.336271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:44.336271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 254/505] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:44.336703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1a6f7-47e9-4131-9adc-097959e49e19 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.336990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1a6f7-47e9-4131-9adc-097959e49e19 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.337267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1a6f7-47e9-4131-9adc-097959e49e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8ee11f7b-965c-43f1-899c-745bedaa54b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:44.343141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:44.367577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:44.368492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:44.368492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:44.368492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:44.368492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:44.368492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 252/506] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:44.368492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee11f7b-965c-43f1-899c-745bedaa54b5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.368815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-59e1a6f7-47e9-4131-9adc-097959e49e19 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:44.368815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-59e1a6f7-47e9-4131-9adc-097959e49e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:44.421293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 255/507] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:44.422135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1a6f7-47e9-4131-9adc-097959e49e19 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.424906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:44.455160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee11f7b-965c-43f1-899c-745bedaa54b5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.524056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1a55c-f053-4ffd-93e9-d4422494a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.524728 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1a55c-f053-4ffd-93e9-d4422494a773 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.525011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1a55c-f053-4ffd-93e9-d4422494a773 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.525285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1a55c-f053-4ffd-93e9-d4422494a773 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.526129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1a55c-f053-4ffd-93e9-d4422494a773 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:44.526441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1a55c-f053-4ffd-93e9-d4422494a773 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:44.527905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1a55c-f053-4ffd-93e9-d4422494a773 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.559221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1a6f7-47e9-4131-9adc-097959e49e19 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.563336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 253/508] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:44.564200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1a55c-f053-4ffd-93e9-d4422494a773 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.595191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b239-fc99-4dbd-b772-26e956b66cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.595858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b239-fc99-4dbd-b772-26e956b66cbb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.596164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b239-fc99-4dbd-b772-26e956b66cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.596437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b239-fc99-4dbd-b772-26e956b66cbb None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.597176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355b239-fc99-4dbd-b772-26e956b66cbb None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:44.597486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355b239-fc99-4dbd-b772-26e956b66cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:44.599070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355b239-fc99-4dbd-b772-26e956b66cbb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.607113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 256/509] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:44.607907 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b239-fc99-4dbd-b772-26e956b66cbb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.620487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:44.665154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1a55c-f053-4ffd-93e9-d4422494a773 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.671121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:44.698375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51030947-1f2b-42ac-9396-32374c8b39d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.699021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51030947-1f2b-42ac-9396-32374c8b39d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.699307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51030947-1f2b-42ac-9396-32374c8b39d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.699583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51030947-1f2b-42ac-9396-32374c8b39d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.700339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51030947-1f2b-42ac-9396-32374c8b39d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:44.700645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51030947-1f2b-42ac-9396-32374c8b39d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:44.702018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51030947-1f2b-42ac-9396-32374c8b39d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.709048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b239-fc99-4dbd-b772-26e956b66cbb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.715400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 254/510] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:44.716238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51030947-1f2b-42ac-9396-32374c8b39d2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.747029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b16b-9574-4d1e-a64e-a685b95ff00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.747679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b16b-9574-4d1e-a64e-a685b95ff00c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.747994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b16b-9574-4d1e-a64e-a685b95ff00c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.748273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b16b-9574-4d1e-a64e-a685b95ff00c None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.748985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b16b-9574-4d1e-a64e-a685b95ff00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:44.749293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b16b-9574-4d1e-a64e-a685b95ff00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:44.750675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b16b-9574-4d1e-a64e-a685b95ff00c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.763475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 257/511] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:44.764375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b16b-9574-4d1e-a64e-a685b95ff00c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.815425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51030947-1f2b-42ac-9396-32374c8b39d2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.831022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:44.848509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc98e-762b-4ae1-8fb5-d0d3f4f828a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.849303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc98e-762b-4ae1-8fb5-d0d3f4f828a6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.849584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc98e-762b-4ae1-8fb5-d0d3f4f828a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.849864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8dc98e-762b-4ae1-8fb5-d0d3f4f828a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.860526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dc98e-762b-4ae1-8fb5-d0d3f4f828a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:44.861962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8dc98e-762b-4ae1-8fb5-d0d3f4f828a6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.865113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b16b-9574-4d1e-a64e-a685b95ff00c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8f8dc98e-762b-4ae1-8fb5-d0d3f4f828a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:44.880077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:44.881060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:44.881907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:44.881907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:44.881907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:44.881907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:44.881907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 255/512] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:44.882170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc98e-762b-4ae1-8fb5-d0d3f4f828a6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:44.895534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:44.906513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851bde9-7eef-41bf-bf30-5a4642767f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:44.907158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851bde9-7eef-41bf-bf30-5a4642767f36 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:44.907441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851bde9-7eef-41bf-bf30-5a4642767f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:44.907713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851bde9-7eef-41bf-bf30-5a4642767f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:44.975032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851bde9-7eef-41bf-bf30-5a4642767f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:44.976537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851bde9-7eef-41bf-bf30-5a4642767f36 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:44.982519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8dc98e-762b-4ae1-8fb5-d0d3f4f828a6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.016753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbe86f-e0e2-4326-adb1-7abd151ea18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.017532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbe86f-e0e2-4326-adb1-7abd151ea18d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.017818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbe86f-e0e2-4326-adb1-7abd151ea18d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.018090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbe86f-e0e2-4326-adb1-7abd151ea18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.029587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbe86f-e0e2-4326-adb1-7abd151ea18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.031023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbe86f-e0e2-4326-adb1-7abd151ea18d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-91dbe86f-e0e2-4326-adb1-7abd151ea18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:45.047764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:45.048651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:45.049470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:45.049470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:45.049470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:45.049470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:45.049470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 256/513] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:45.049720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbe86f-e0e2-4326-adb1-7abd151ea18d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.073867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:45.081736 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 258/514] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:45.082829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851bde9-7eef-41bf-bf30-5a4642767f36 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.107197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:45.154039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbe86f-e0e2-4326-adb1-7abd151ea18d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.181497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851bde9-7eef-41bf-bf30-5a4642767f36 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.188017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a197c57-a4b9-4ed7-8c00-4bb367d7ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.188873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a197c57-a4b9-4ed7-8c00-4bb367d7ac4e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.189156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a197c57-a4b9-4ed7-8c00-4bb367d7ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.189429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a197c57-a4b9-4ed7-8c00-4bb367d7ac4e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.197597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a197c57-a4b9-4ed7-8c00-4bb367d7ac4e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.199067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a197c57-a4b9-4ed7-8c00-4bb367d7ac4e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4a197c57-a4b9-4ed7-8c00-4bb367d7ac4e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:45.213231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:45.214189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:45.215070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 257/515] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:45.215826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a197c57-a4b9-4ed7-8c00-4bb367d7ac4e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.219714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756deef-9c1e-48b9-971c-43c6dee2fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.220533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756deef-9c1e-48b9-971c-43c6dee2fef0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.220814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756deef-9c1e-48b9-971c-43c6dee2fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.221087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756deef-9c1e-48b9-971c-43c6dee2fef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.228187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756deef-9c1e-48b9-971c-43c6dee2fef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.229629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756deef-9c1e-48b9-971c-43c6dee2fef0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a756deef-9c1e-48b9-971c-43c6dee2fef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:45.244188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:45.245006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 259/516] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:45.246239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756deef-9c1e-48b9-971c-43c6dee2fef0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.298699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:45.317720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a197c57-a4b9-4ed7-8c00-4bb367d7ac4e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.331824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:45.347020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756deef-9c1e-48b9-971c-43c6dee2fef0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.351576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e164d2c-ca19-42fa-8750-c4ed0449fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.352526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e164d2c-ca19-42fa-8750-c4ed0449fb9f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.352807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e164d2c-ca19-42fa-8750-c4ed0449fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.353079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e164d2c-ca19-42fa-8750-c4ed0449fb9f None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.353795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e164d2c-ca19-42fa-8750-c4ed0449fb9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:45.354098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e164d2c-ca19-42fa-8750-c4ed0449fb9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.355513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e164d2c-ca19-42fa-8750-c4ed0449fb9f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.366848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 258/517] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:45.367630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e164d2c-ca19-42fa-8750-c4ed0449fb9f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.382293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de27b81-15b4-4511-8c4b-4fed48b2eb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.382963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27b81-15b4-4511-8c4b-4fed48b2eb7d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.383251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27b81-15b4-4511-8c4b-4fed48b2eb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.383531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de27b81-15b4-4511-8c4b-4fed48b2eb7d None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.384284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de27b81-15b4-4511-8c4b-4fed48b2eb7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:45.384597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de27b81-15b4-4511-8c4b-4fed48b2eb7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.385986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de27b81-15b4-4511-8c4b-4fed48b2eb7d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.398771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 260/518] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:45.399564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de27b81-15b4-4511-8c4b-4fed48b2eb7d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.473481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e164d2c-ca19-42fa-8750-c4ed0449fb9f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.502933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de27b81-15b4-4511-8c4b-4fed48b2eb7d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.508206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4becbe-cf96-4be6-8ef4-84becd6f2b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.509002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4becbe-cf96-4be6-8ef4-84becd6f2b99 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.509282 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4becbe-cf96-4be6-8ef4-84becd6f2b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.509556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4becbe-cf96-4be6-8ef4-84becd6f2b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.518584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:45.523533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4becbe-cf96-4be6-8ef4-84becd6f2b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.525058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4becbe-cf96-4be6-8ef4-84becd6f2b99 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.540394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f75ba-7c2e-46b1-b7db-bc087a7b5ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.541145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f75ba-7c2e-46b1-b7db-bc087a7b5ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.541426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f75ba-7c2e-46b1-b7db-bc087a7b5ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.541700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f75ba-7c2e-46b1-b7db-bc087a7b5ad5 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.542528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f75ba-7c2e-46b1-b7db-bc087a7b5ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7a4becbe-cf96-4be6-8ef4-84becd6f2b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:45.542669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:45.543494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:45.544568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:45.544568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:45.544568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:45.544568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:45.544789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f75ba-7c2e-46b1-b7db-bc087a7b5ad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.544856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 259/519] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:45.544927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f75ba-7c2e-46b1-b7db-bc087a7b5ad5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.545000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4becbe-cf96-4be6-8ef4-84becd6f2b99 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.564823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 261/520] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:45.565624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f75ba-7c2e-46b1-b7db-bc087a7b5ad5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.568262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:45.642339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4becbe-cf96-4be6-8ef4-84becd6f2b99 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.665787 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f75ba-7c2e-46b1-b7db-bc087a7b5ad5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.676311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95433ab5-3b71-4f37-995b-d2b2ce4151fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.676965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95433ab5-3b71-4f37-995b-d2b2ce4151fa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.677252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95433ab5-3b71-4f37-995b-d2b2ce4151fa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.677555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95433ab5-3b71-4f37-995b-d2b2ce4151fa None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.678370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95433ab5-3b71-4f37-995b-d2b2ce4151fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:45.678680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95433ab5-3b71-4f37-995b-d2b2ce4151fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.680130 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95433ab5-3b71-4f37-995b-d2b2ce4151fa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.698025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 260/521] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:45.698817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95433ab5-3b71-4f37-995b-d2b2ce4151fa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.699734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721feabb-a5ea-465f-b7ce-0049b227db1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.700439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721feabb-a5ea-465f-b7ce-0049b227db1d None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.700726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721feabb-a5ea-465f-b7ce-0049b227db1d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.701007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721feabb-a5ea-465f-b7ce-0049b227db1d None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.701710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721feabb-a5ea-465f-b7ce-0049b227db1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.703176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721feabb-a5ea-465f-b7ce-0049b227db1d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.751010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:45.776047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 262/522] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:55:45 2022] POST /identity/v3/users => generated 247 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:55:45.776959 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721feabb-a5ea-465f-b7ce-0049b227db1d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.800442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95433ab5-3b71-4f37-995b-d2b2ce4151fa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.837703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348fe10-cb13-4acd-b18c-cd1e74161be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.838524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348fe10-cb13-4acd-b18c-cd1e74161be3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.838809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348fe10-cb13-4acd-b18c-cd1e74161be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.839086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348fe10-cb13-4acd-b18c-cd1e74161be3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.848430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348fe10-cb13-4acd-b18c-cd1e74161be3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.849931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348fe10-cb13-4acd-b18c-cd1e74161be3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.860529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5348fe10-cb13-4acd-b18c-cd1e74161be3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:45.865297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:45.866554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 261/523] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:45.873757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348fe10-cb13-4acd-b18c-cd1e74161be3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.923933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721feabb-a5ea-465f-b7ce-0049b227db1d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:45.962104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad99eb8-4b4e-4c3a-be94-d03b68fbbcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:45.963027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad99eb8-4b4e-4c3a-be94-d03b68fbbcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:45.963152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad99eb8-4b4e-4c3a-be94-d03b68fbbcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:45.963342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad99eb8-4b4e-4c3a-be94-d03b68fbbcc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:45.964535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad99eb8-4b4e-4c3a-be94-d03b68fbbcc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:45.964535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad99eb8-4b4e-4c3a-be94-d03b68fbbcc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:45.966011 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad99eb8-4b4e-4c3a-be94-d03b68fbbcc0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:45.979519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 263/524] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:45.980193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad99eb8-4b4e-4c3a-be94-d03b68fbbcc0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:45.992507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348fe10-cb13-4acd-b18c-cd1e74161be3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:46.007117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:46.031360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142ae83-263b-4c08-b3e5-e403b9148f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:46.032150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142ae83-263b-4c08-b3e5-e403b9148f04 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:46.032582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142ae83-263b-4c08-b3e5-e403b9148f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:46.032835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142ae83-263b-4c08-b3e5-e403b9148f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:46.087329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad99eb8-4b4e-4c3a-be94-d03b68fbbcc0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:46.104826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:46.108009 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142ae83-263b-4c08-b3e5-e403b9148f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:46.109576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142ae83-263b-4c08-b3e5-e403b9148f04 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:46.121243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42554b-2dc0-406c-8d61-9329ef44e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:46.121911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42554b-2dc0-406c-8d61-9329ef44e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:46.122198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42554b-2dc0-406c-8d61-9329ef44e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:46.122472 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42554b-2dc0-406c-8d61-9329ef44e2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:46.123309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42554b-2dc0-406c-8d61-9329ef44e2c7 None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=fbfe6b7a82f746169a39976be263aa29) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:46.123620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42554b-2dc0-406c-8d61-9329ef44e2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:46.125103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42554b-2dc0-406c-8d61-9329ef44e2c7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:46.135908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 264/525] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/role_assignments?user.id=fbfe6b7a82f746169a39976be263aa29&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:46.135908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42554b-2dc0-406c-8d61-9329ef44e2c7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:46.240166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 262/526] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:46.243098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142ae83-263b-4c08-b3e5-e403b9148f04 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:46.259666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:46.272313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42554b-2dc0-406c-8d61-9329ef44e2c7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:46.329477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac577-3eb0-4007-ad1f-2a11e1c97ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:46.330255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac577-3eb0-4007-ad1f-2a11e1c97ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:46.330652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac577-3eb0-4007-ad1f-2a11e1c97ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:46.331034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ac577-3eb0-4007-ad1f-2a11e1c97ed6 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:46.332188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac577-3eb0-4007-ad1f-2a11e1c97ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:46.332611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac577-3eb0-4007-ad1f-2a11e1c97ed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:46.334173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ac577-3eb0-4007-ad1f-2a11e1c97ed6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:46.356061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 265/527] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Jun 28 11:55:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:46.357066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac577-3eb0-4007-ad1f-2a11e1c97ed6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:46.366986 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142ae83-263b-4c08-b3e5-e403b9148f04 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:46.402835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:46.415036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dfea4-564e-46f1-bec6-f509a14804db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:46.416021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dfea4-564e-46f1-bec6-f509a14804db None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:46.416368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dfea4-564e-46f1-bec6-f509a14804db None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:46.416705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3dfea4-564e-46f1-bec6-f509a14804db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:46.424097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dfea4-564e-46f1-bec6-f509a14804db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:46.425943 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3dfea4-564e-46f1-bec6-f509a14804db None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0f3dfea4-564e-46f1-bec6-f509a14804db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:46.441132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:46.442126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:46.443002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:46.443002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:46.443002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:46.443002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:46.443002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:46.443002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:46.443002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:46.443002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:46.443673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 263/528] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:46.448282 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dfea4-564e-46f1-bec6-f509a14804db None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:46.478620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ac577-3eb0-4007-ad1f-2a11e1c97ed6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:46.524469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:46.527579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcad02-a50f-45cc-b824-ee1d86ce2e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:46.528651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcad02-a50f-45cc-b824-ee1d86ce2e88 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:46.529132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcad02-a50f-45cc-b824-ee1d86ce2e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:46.529847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcad02-a50f-45cc-b824-ee1d86ce2e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:46.541954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcad02-a50f-45cc-b824-ee1d86ce2e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:46.543785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcad02-a50f-45cc-b824-ee1d86ce2e88 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:46.557173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3dfea4-564e-46f1-bec6-f509a14804db None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-4bdcad02-a50f-45cc-b824-ee1d86ce2e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:46.563539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:46.564430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:46.565236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:46.565236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:46.565236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:46.565236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:46.567143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 266/529] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:46.568177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcad02-a50f-45cc-b824-ee1d86ce2e88 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:46.598226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6375c-b009-49ea-8120-49ecbb101da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:46.598915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6375c-b009-49ea-8120-49ecbb101da0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:46.599206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6375c-b009-49ea-8120-49ecbb101da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:46.599491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6375c-b009-49ea-8120-49ecbb101da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:46.670645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:46.680433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcad02-a50f-45cc-b824-ee1d86ce2e88 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:46.696316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6375c-b009-49ea-8120-49ecbb101da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:46.697786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6375c-b009-49ea-8120-49ecbb101da0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:46.723261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8618-9d7e-4056-83c4-6e1c2b5b49b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:46.724352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8618-9d7e-4056-83c4-6e1c2b5b49b5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:46.724832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8618-9d7e-4056-83c4-6e1c2b5b49b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:46.725333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8618-9d7e-4056-83c4-6e1c2b5b49b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:46.726365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8618-9d7e-4056-83c4-6e1c2b5b49b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:46.726866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8618-9d7e-4056-83c4-6e1c2b5b49b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:46.728855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8618-9d7e-4056-83c4-6e1c2b5b49b5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:46.752149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 267/530] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:46.753318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8618-9d7e-4056-83c4-6e1c2b5b49b5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:46.778087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:46.815158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 264/531] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:46.815158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6375c-b009-49ea-8120-49ecbb101da0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:46.864277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8618-9d7e-4056-83c4-6e1c2b5b49b5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:46.899847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247815e-f0d2-4881-87c9-1e82c04e9032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:46.900896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247815e-f0d2-4881-87c9-1e82c04e9032 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:46.901408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247815e-f0d2-4881-87c9-1e82c04e9032 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:46.901890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247815e-f0d2-4881-87c9-1e82c04e9032 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:46.903401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247815e-f0d2-4881-87c9-1e82c04e9032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:46.903950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247815e-f0d2-4881-87c9-1e82c04e9032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:46.905581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247815e-f0d2-4881-87c9-1e82c04e9032 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:46.918628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 268/532] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:46.919881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247815e-f0d2-4881-87c9-1e82c04e9032 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:46.922765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6375c-b009-49ea-8120-49ecbb101da0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:46.935960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:46.964019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5367f8-1b9d-4f0e-a685-a712880927ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:46.964942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5367f8-1b9d-4f0e-a685-a712880927ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:46.965357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5367f8-1b9d-4f0e-a685-a712880927ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:46.965818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5367f8-1b9d-4f0e-a685-a712880927ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:46.966775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5367f8-1b9d-4f0e-a685-a712880927ba None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=6784d862961b44f48b385bec777ac439) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:46.967188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5367f8-1b9d-4f0e-a685-a712880927ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:46.968800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5367f8-1b9d-4f0e-a685-a712880927ba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:46.984198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 265/533] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:46 2022] GET /identity/v3/role_assignments?user.id=6784d862961b44f48b385bec777ac439&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:46.985469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5367f8-1b9d-4f0e-a685-a712880927ba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:47.051672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247815e-f0d2-4881-87c9-1e82c04e9032 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:47.071415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:47.103064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389fc6a-f9e7-48bd-b16f-269ae19e08f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:47.104449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389fc6a-f9e7-48bd-b16f-269ae19e08f5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.104936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389fc6a-f9e7-48bd-b16f-269ae19e08f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.105409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389fc6a-f9e7-48bd-b16f-269ae19e08f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.120520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389fc6a-f9e7-48bd-b16f-269ae19e08f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:47.122599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389fc6a-f9e7-48bd-b16f-269ae19e08f5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e389fc6a-f9e7-48bd-b16f-269ae19e08f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:47.161670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:47.162589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:47.163404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:47.163404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:47.163404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:47.163404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:47.163404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 269/534] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:47.173108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389fc6a-f9e7-48bd-b16f-269ae19e08f5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:47.202775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5367f8-1b9d-4f0e-a685-a712880927ba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:47.255002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c8f45-d4fc-468b-9cef-105cd42fcdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:47.256152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c8f45-d4fc-468b-9cef-105cd42fcdac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.256611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c8f45-d4fc-468b-9cef-105cd42fcdac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.257058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c8f45-d4fc-468b-9cef-105cd42fcdac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.264921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c8f45-d4fc-468b-9cef-105cd42fcdac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:47.267034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c8f45-d4fc-468b-9cef-105cd42fcdac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-bd1c8f45-d4fc-468b-9cef-105cd42fcdac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:47.284523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:47.286256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:47.287087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:47.287087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:47.287087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:47.287087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:47.287087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:47.287087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:47.287087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:47.287087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:47.289520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 266/535] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:47.294734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c8f45-d4fc-468b-9cef-105cd42fcdac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:47.308386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:47.366644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389fc6a-f9e7-48bd-b16f-269ae19e08f5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:47.403618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2f54d-ffad-4975-95c4-8efe0406455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:47.404698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2f54d-ffad-4975-95c4-8efe0406455f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.405174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2f54d-ffad-4975-95c4-8efe0406455f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.405639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2f54d-ffad-4975-95c4-8efe0406455f None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.406570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2f54d-ffad-4975-95c4-8efe0406455f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:47.407069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2f54d-ffad-4975-95c4-8efe0406455f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:47.408686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2f54d-ffad-4975-95c4-8efe0406455f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:47.422257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 270/536] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:47.427920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2f54d-ffad-4975-95c4-8efe0406455f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:47.476135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:47.491897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c8f45-d4fc-468b-9cef-105cd42fcdac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:47.535582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2f54d-ffad-4975-95c4-8efe0406455f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:47.556244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feacef8-7c24-4a1b-ae29-c6889f22ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:47.557153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feacef8-7c24-4a1b-ae29-c6889f22ca81 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.557590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feacef8-7c24-4a1b-ae29-c6889f22ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.558507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feacef8-7c24-4a1b-ae29-c6889f22ca81 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.559753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feacef8-7c24-4a1b-ae29-c6889f22ca81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:47.560237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feacef8-7c24-4a1b-ae29-c6889f22ca81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:47.561309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:47.562088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feacef8-7c24-4a1b-ae29-c6889f22ca81 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:47.573058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99fb63-0aa3-4a33-986c-6b72c2b08de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:47.579783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99fb63-0aa3-4a33-986c-6b72c2b08de8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.579783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99fb63-0aa3-4a33-986c-6b72c2b08de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.579783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99fb63-0aa3-4a33-986c-6b72c2b08de8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.583242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99fb63-0aa3-4a33-986c-6b72c2b08de8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:47.584909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99fb63-0aa3-4a33-986c-6b72c2b08de8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:47.590424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 267/537] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:47.595981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feacef8-7c24-4a1b-ae29-c6889f22ca81 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-9b99fb63-0aa3-4a33-986c-6b72c2b08de8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:47.599924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:47.600789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:47.601601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:47.601601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:47.601601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:47.601601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:47.601601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:47.601601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:47.601601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:47.601601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:47.601601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 271/538] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:47.607384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99fb63-0aa3-4a33-986c-6b72c2b08de8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:47.716672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99fb63-0aa3-4a33-986c-6b72c2b08de8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:47.758069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8b3cf-a822-470c-8103-d1b490c8bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:47.758731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8b3cf-a822-470c-8103-d1b490c8bd2a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.759011 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8b3cf-a822-470c-8103-d1b490c8bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.759285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8b3cf-a822-470c-8103-d1b490c8bd2a None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.760241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8b3cf-a822-470c-8103-d1b490c8bd2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:47.760589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8b3cf-a822-470c-8103-d1b490c8bd2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:47.762715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8b3cf-a822-470c-8103-d1b490c8bd2a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:47.777624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 272/539] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:47.783633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8b3cf-a822-470c-8103-d1b490c8bd2a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:47.840533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:47.888002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8b3cf-a822-470c-8103-d1b490c8bd2a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:47.924084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafce55-68ec-475a-bcf9-9b10a00cf40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:47.924774 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafce55-68ec-475a-bcf9-9b10a00cf40d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.925055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafce55-68ec-475a-bcf9-9b10a00cf40d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.925982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafce55-68ec-475a-bcf9-9b10a00cf40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.926991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafce55-68ec-475a-bcf9-9b10a00cf40d None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=62bbcb039ed44749ab80bfc97dabd7b4) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:47.927108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feacef8-7c24-4a1b-ae29-c6889f22ca81 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:47.927303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafce55-68ec-475a-bcf9-9b10a00cf40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:47.928897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafce55-68ec-475a-bcf9-9b10a00cf40d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:47.934900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 273/540] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:47 2022] GET /identity/v3/role_assignments?user.id=62bbcb039ed44749ab80bfc97dabd7b4&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:47.978562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9637f-5a8f-4eb7-91bb-ceabe8a2cd82 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.978862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9637f-5a8f-4eb7-91bb-ceabe8a2cd82 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.979114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9637f-5a8f-4eb7-91bb-ceabe8a2cd82 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.980628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 274/541] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:55:47.989743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82311e-a46f-42f2-8add-cdeaa5daa975 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.990063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82311e-a46f-42f2-8add-cdeaa5daa975 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.990424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82311e-a46f-42f2-8add-cdeaa5daa975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.995440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc238a-b29c-4506-93cb-c2c8c062bb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:47.996174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc238a-b29c-4506-93cb-c2c8c062bb42 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:47.996463 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc238a-b29c-4506-93cb-c2c8c062bb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:47.996739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc238a-b29c-4506-93cb-c2c8c062bb42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:47.997598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc238a-b29c-4506-93cb-c2c8c062bb42 None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=3ff61c1fbdf34fa38588e4cd2cdc5398) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:47.997912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc238a-b29c-4506-93cb-c2c8c062bb42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:47.999468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc238a-b29c-4506-93cb-c2c8c062bb42 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:48.012716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 268/542] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:47 2022] GET /identity/v3/role_assignments?user.id=3ff61c1fbdf34fa38588e4cd2cdc5398&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 259 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:48.028200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-aa82311e-a46f-42f2-8add-cdeaa5daa975 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:48.029448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aa82311e-a46f-42f2-8add-cdeaa5daa975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:48.153038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 275/543] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:48.191700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc238a-b29c-4506-93cb-c2c8c062bb42 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:48.221881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:48.315591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc238a-b29c-4506-93cb-c2c8c062bb42 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:48.368592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0b327-c439-442e-b489-c2d42846eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:48.369457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b327-c439-442e-b489-c2d42846eee4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:48.369742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b327-c439-442e-b489-c2d42846eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:48.370015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b327-c439-442e-b489-c2d42846eee4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:48.381398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0b327-c439-442e-b489-c2d42846eee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-78e0b327-c439-442e-b489-c2d42846eee4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:48.389514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:48.390374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:48.391146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 269/544] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:48.401141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82311e-a46f-42f2-8add-cdeaa5daa975 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:48.424911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffb6a-8778-47bd-90aa-ef193c68ca20 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:48.425094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffb6a-8778-47bd-90aa-ef193c68ca20 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:48.425430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffb6a-8778-47bd-90aa-ef193c68ca20 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:48.428047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 270/545] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:48.433863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6e312-8ed6-40f8-b25e-453c3e2174fc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:48.434425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6e312-8ed6-40f8-b25e-453c3e2174fc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:48.437445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6e312-8ed6-40f8-b25e-453c3e2174fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:48.459271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bbf6e312-8ed6-40f8-b25e-453c3e2174fc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:48.460722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bbf6e312-8ed6-40f8-b25e-453c3e2174fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:48.525342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:48.565062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 271/546] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:55:48.598857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6e312-8ed6-40f8-b25e-453c3e2174fc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:48.620103 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:48.653614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82311e-a46f-42f2-8add-cdeaa5daa975 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:48.725393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a7c1e-e8e1-4b02-b66b-32832971040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:48.725992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a7c1e-e8e1-4b02-b66b-32832971040c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:48.726278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a7c1e-e8e1-4b02-b66b-32832971040c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:48.726556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a7c1e-e8e1-4b02-b66b-32832971040c None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:48.727569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a7c1e-e8e1-4b02-b66b-32832971040c None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:48.727897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a7c1e-e8e1-4b02-b66b-32832971040c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:48.729297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a7c1e-e8e1-4b02-b66b-32832971040c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:48.757859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 276/547] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:48.760163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a7c1e-e8e1-4b02-b66b-32832971040c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:48.800708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6e312-8ed6-40f8-b25e-453c3e2174fc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:48.871225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4beab9-4e67-461a-8c05-438b64e01e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:48.872054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4beab9-4e67-461a-8c05-438b64e01e4e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:48.872340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4beab9-4e67-461a-8c05-438b64e01e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:48.872619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4beab9-4e67-461a-8c05-438b64e01e4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:48.894917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4beab9-4e67-461a-8c05-438b64e01e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6b4beab9-4e67-461a-8c05-438b64e01e4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:48.902739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:48.903694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:48.904493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 272/548] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:48.921198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4beab9-4e67-461a-8c05-438b64e01e4e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:48.928756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:48.932333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a7c1e-e8e1-4b02-b66b-32832971040c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:48.985236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd497bd6-76ef-4eb0-be3e-62a7b0d518a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:48.986295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd497bd6-76ef-4eb0-be3e-62a7b0d518a8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:48.986743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd497bd6-76ef-4eb0-be3e-62a7b0d518a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:48.987164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd497bd6-76ef-4eb0-be3e-62a7b0d518a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.009088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd497bd6-76ef-4eb0-be3e-62a7b0d518a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:49.010826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd497bd6-76ef-4eb0-be3e-62a7b0d518a8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:49.028808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-fd497bd6-76ef-4eb0-be3e-62a7b0d518a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:49.041190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:49.042162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:49.043298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:49.043298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:49.043298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:49.043298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:49.043298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 277/549] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:49.049277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd497bd6-76ef-4eb0-be3e-62a7b0d518a8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:49.059648 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4beab9-4e67-461a-8c05-438b64e01e4e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:49.099576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c76a4a-0bee-43ba-87f7-01f4c4b2feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:49.100280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c76a4a-0bee-43ba-87f7-01f4c4b2feb4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.100569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c76a4a-0bee-43ba-87f7-01f4c4b2feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.100851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c76a4a-0bee-43ba-87f7-01f4c4b2feb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.101618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c76a4a-0bee-43ba-87f7-01f4c4b2feb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:49.102193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c76a4a-0bee-43ba-87f7-01f4c4b2feb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:49.106650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c76a4a-0bee-43ba-87f7-01f4c4b2feb4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:49.125019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 273/550] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:49.130815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c76a4a-0bee-43ba-87f7-01f4c4b2feb4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:49.261978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd497bd6-76ef-4eb0-be3e-62a7b0d518a8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:49.310425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aeb90-301d-4852-b77d-11c0ae187c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:49.311104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aeb90-301d-4852-b77d-11c0ae187c92 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.311397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aeb90-301d-4852-b77d-11c0ae187c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.311688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2aeb90-301d-4852-b77d-11c0ae187c92 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.312461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2aeb90-301d-4852-b77d-11c0ae187c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:49.313074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2aeb90-301d-4852-b77d-11c0ae187c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:49.315046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2aeb90-301d-4852-b77d-11c0ae187c92 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:49.329919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 278/551] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:49.335579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aeb90-301d-4852-b77d-11c0ae187c92 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:49.338031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c76a4a-0bee-43ba-87f7-01f4c4b2feb4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:49.368214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:49.394494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:49.404536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f664d-520c-4c1f-9d98-e89f2cf90c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:49.405636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f664d-520c-4c1f-9d98-e89f2cf90c60 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.406121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f664d-520c-4c1f-9d98-e89f2cf90c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.406594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f664d-520c-4c1f-9d98-e89f2cf90c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.427004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f664d-520c-4c1f-9d98-e89f2cf90c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:49.428702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f664d-520c-4c1f-9d98-e89f2cf90c60 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1b9f664d-520c-4c1f-9d98-e89f2cf90c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:49.463261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:49.464244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:49.465112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:49.465112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:49.465112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:49.465112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:49.465112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 274/552] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:49.471618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f664d-520c-4c1f-9d98-e89f2cf90c60 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:49.522759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2aeb90-301d-4852-b77d-11c0ae187c92 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:49.563247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84ebf-d84d-4c93-8e71-f7926c64ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:49.564337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84ebf-d84d-4c93-8e71-f7926c64ca13 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.564622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84ebf-d84d-4c93-8e71-f7926c64ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.564898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84ebf-d84d-4c93-8e71-f7926c64ca13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.574549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84ebf-d84d-4c93-8e71-f7926c64ca13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:49.576298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84ebf-d84d-4c93-8e71-f7926c64ca13 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-7bb84ebf-d84d-4c93-8e71-f7926c64ca13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:49.596353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:49.597948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:49.599029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 279/553] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:55:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:49.600693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b784e4-6dd7-4ea5-83a2-97dc40809866 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.600693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b784e4-6dd7-4ea5-83a2-97dc40809866 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.600693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b784e4-6dd7-4ea5-83a2-97dc40809866 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.602776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 280/554] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:49.608046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b784e4-6dd7-4ea5-83a2-97dc40809866 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:49.636590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f664d-520c-4c1f-9d98-e89f2cf90c60 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:49.686780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec68519-5cd5-40d0-bca3-b559d8bdf25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:49.687817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec68519-5cd5-40d0-bca3-b559d8bdf25c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.688202 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec68519-5cd5-40d0-bca3-b559d8bdf25c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.688732 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec68519-5cd5-40d0-bca3-b559d8bdf25c None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.689786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec68519-5cd5-40d0-bca3-b559d8bdf25c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:49.690171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec68519-5cd5-40d0-bca3-b559d8bdf25c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:49.692411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec68519-5cd5-40d0-bca3-b559d8bdf25c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:49.704184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:49.710779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 275/555] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:49.712451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93006fc6-ae20-4d1f-bfda-d9516ee02fe0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.712949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93006fc6-ae20-4d1f-bfda-d9516ee02fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.713481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93006fc6-ae20-4d1f-bfda-d9516ee02fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.736010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-93006fc6-ae20-4d1f-bfda-d9516ee02fe0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:49.738338 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-93006fc6-ae20-4d1f-bfda-d9516ee02fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:49.741404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b784e4-6dd7-4ea5-83a2-97dc40809866 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:49.787754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72da8c-9594-413d-8628-5a621051cf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:49.788504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72da8c-9594-413d-8628-5a621051cf3c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.788858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72da8c-9594-413d-8628-5a621051cf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.789212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72da8c-9594-413d-8628-5a621051cf3c None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.790235 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72da8c-9594-413d-8628-5a621051cf3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:49.790615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72da8c-9594-413d-8628-5a621051cf3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:49.792419 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72da8c-9594-413d-8628-5a621051cf3c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:49.800091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:49.819247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 281/556] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Jun 28 11:55:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:49.819247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72da8c-9594-413d-8628-5a621051cf3c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:49.836238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 276/557] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:49.837508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93006fc6-ae20-4d1f-bfda-d9516ee02fe0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:49.944627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93006fc6-ae20-4d1f-bfda-d9516ee02fe0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:49.948987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72da8c-9594-413d-8628-5a621051cf3c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:49.981473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:49.982962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a4778-511d-41b0-a544-1c1fb7b2c0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:49.983844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4778-511d-41b0-a544-1c1fb7b2c0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.984356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4778-511d-41b0-a544-1c1fb7b2c0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.984902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a4778-511d-41b0-a544-1c1fb7b2c0b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.988537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e66f1-b07b-42d8-9ddb-52ab95186f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:49.989598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e66f1-b07b-42d8-9ddb-52ab95186f01 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:49.989889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e66f1-b07b-42d8-9ddb-52ab95186f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:49.990171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e66f1-b07b-42d8-9ddb-52ab95186f01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:49.998568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e66f1-b07b-42d8-9ddb-52ab95186f01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:50.000076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e66f1-b07b-42d8-9ddb-52ab95186f01 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a73e66f1-b07b-42d8-9ddb-52ab95186f01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:50.015656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:50.017127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:55:50.018496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:50.021549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 282/558] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Jun 28 11:55:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:50.022433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e66f1-b07b-42d8-9ddb-52ab95186f01 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:50.039578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:50.067309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a4778-511d-41b0-a544-1c1fb7b2c0b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:50.069231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a4778-511d-41b0-a544-1c1fb7b2c0b1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:50.130866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e66f1-b07b-42d8-9ddb-52ab95186f01 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:50.167961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f82b9-3015-4819-a53e-ecf66e3e78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:50.168837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f82b9-3015-4819-a53e-ecf66e3e78df None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.169046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f82b9-3015-4819-a53e-ecf66e3e78df None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.169322 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f82b9-3015-4819-a53e-ecf66e3e78df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.181804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f82b9-3015-4819-a53e-ecf66e3e78df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:50.182142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 277/559] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:50.183287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a4778-511d-41b0-a544-1c1fb7b2c0b1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5d5f82b9-3015-4819-a53e-ecf66e3e78df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:50.188847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:50.189873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:50.191143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:50.195479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 283/560] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:50.196226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f82b9-3015-4819-a53e-ecf66e3e78df None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:50.250477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:50.268566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:50.295469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a4778-511d-41b0-a544-1c1fb7b2c0b1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:50.303142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f82b9-3015-4819-a53e-ecf66e3e78df None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:50.331267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f46ce-7b4e-4ee7-a05e-4991c6a7d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:50.332865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f46ce-7b4e-4ee7-a05e-4991c6a7d6ee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.333264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f46ce-7b4e-4ee7-a05e-4991c6a7d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.333545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f46ce-7b4e-4ee7-a05e-4991c6a7d6ee None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.334391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f46ce-7b4e-4ee7-a05e-4991c6a7d6ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:50.334700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f46ce-7b4e-4ee7-a05e-4991c6a7d6ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:50.336161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f46ce-7b4e-4ee7-a05e-4991c6a7d6ee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:50.338385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f54bf-8b7a-489f-b19e-03262063803e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:50.339190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f54bf-8b7a-489f-b19e-03262063803e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.339476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f54bf-8b7a-489f-b19e-03262063803e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.339761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f54bf-8b7a-489f-b19e-03262063803e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.351504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f54bf-8b7a-489f-b19e-03262063803e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:50.353252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f54bf-8b7a-489f-b19e-03262063803e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:50.356713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 278/561] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:50.357694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f46ce-7b4e-4ee7-a05e-4991c6a7d6ee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ac2f54bf-8b7a-489f-b19e-03262063803e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:50.376715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:50.377721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:50.379321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:50.379321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:50.379321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:50.379321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:50.379321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 284/562] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:50.379628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65c91-8ce5-4ceb-8496-68412e79ecdf None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.379955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65c91-8ce5-4ceb-8496-68412e79ecdf None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.380191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65c91-8ce5-4ceb-8496-68412e79ecdf None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.381625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 285/563] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:50.382145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65c91-8ce5-4ceb-8496-68412e79ecdf None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:50.471925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f46ce-7b4e-4ee7-a05e-4991c6a7d6ee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:50.485756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65c91-8ce5-4ceb-8496-68412e79ecdf None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:50.487362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:50.578997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:50.583915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107efd3-a1ff-4864-a82c-483113c99f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:50.584299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a14be-f2b2-4f10-b2f8-311ecb307a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:50.584718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107efd3-a1ff-4864-a82c-483113c99f59 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.584960 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a14be-f2b2-4f10-b2f8-311ecb307a17 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.585054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107efd3-a1ff-4864-a82c-483113c99f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.585242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a14be-f2b2-4f10-b2f8-311ecb307a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.585332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107efd3-a1ff-4864-a82c-483113c99f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.585515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a14be-f2b2-4f10-b2f8-311ecb307a17 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.586388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a14be-f2b2-4f10-b2f8-311ecb307a17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:50.586690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a14be-f2b2-4f10-b2f8-311ecb307a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:50.588077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a14be-f2b2-4f10-b2f8-311ecb307a17 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:50.595851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107efd3-a1ff-4864-a82c-483113c99f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:50.596006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 279/564] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:50.596665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a14be-f2b2-4f10-b2f8-311ecb307a17 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:50.597848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107efd3-a1ff-4864-a82c-483113c99f59 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c107efd3-a1ff-4864-a82c-483113c99f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:50.616759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:50.617819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:50.618725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:50.618725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:50.618725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:50.618725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:50.618725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 286/565] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:50.619523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4b021-3246-4126-9364-b34d0766df40 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.619808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4b021-3246-4126-9364-b34d0766df40 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.620108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4b021-3246-4126-9364-b34d0766df40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.636551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-07b4b021-3246-4126-9364-b34d0766df40 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:50.637725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-07b4b021-3246-4126-9364-b34d0766df40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:50.701285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a14be-f2b2-4f10-b2f8-311ecb307a17 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:50.702753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 287/566] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:50.705190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becaea0-c8b6-4a59-ae92-20735b2e60fe None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.705478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becaea0-c8b6-4a59-ae92-20735b2e60fe None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.705754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becaea0-c8b6-4a59-ae92-20735b2e60fe None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.707283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 288/567] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:50.709134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becaea0-c8b6-4a59-ae92-20735b2e60fe None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:50.736722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e702a2-c337-4795-98c7-2e6789ab0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:50.737385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e702a2-c337-4795-98c7-2e6789ab0de1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.737723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e702a2-c337-4795-98c7-2e6789ab0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.737998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e702a2-c337-4795-98c7-2e6789ab0de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.738726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e702a2-c337-4795-98c7-2e6789ab0de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:50.739034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e702a2-c337-4795-98c7-2e6789ab0de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:50.740518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e702a2-c337-4795-98c7-2e6789ab0de1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:50.752084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 280/568] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:50.752722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e702a2-c337-4795-98c7-2e6789ab0de1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:50.796406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:50.806968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:50.814598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becaea0-c8b6-4a59-ae92-20735b2e60fe None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:50.850640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243382e6-f27f-4a94-88ac-55a288f32a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:50.851405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243382e6-f27f-4a94-88ac-55a288f32a15 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.851690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243382e6-f27f-4a94-88ac-55a288f32a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.852079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e702a2-c337-4795-98c7-2e6789ab0de1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:50.852251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243382e6-f27f-4a94-88ac-55a288f32a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.862236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243382e6-f27f-4a94-88ac-55a288f32a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:50.864275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243382e6-f27f-4a94-88ac-55a288f32a15 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-243382e6-f27f-4a94-88ac-55a288f32a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:50.881987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:50.883027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:50.884142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:50.884142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:50.884142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:50.884142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:50.884142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 289/569] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:50.884797 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2787e-1274-40b0-a04e-c406d5d421e3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.885085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2787e-1274-40b0-a04e-c406d5d421e3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.885362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2787e-1274-40b0-a04e-c406d5d421e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.893377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4498c-7cfe-42b5-8a8d-9c4bd4933007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:50.894126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4498c-7cfe-42b5-8a8d-9c4bd4933007 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:50.894415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4498c-7cfe-42b5-8a8d-9c4bd4933007 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:50.894773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4498c-7cfe-42b5-8a8d-9c4bd4933007 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:50.895498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4498c-7cfe-42b5-8a8d-9c4bd4933007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:50.895808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4498c-7cfe-42b5-8a8d-9c4bd4933007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:50.897215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4498c-7cfe-42b5-8a8d-9c4bd4933007 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:50.901259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e5b2787e-1274-40b0-a04e-c406d5d421e3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:50.902436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e5b2787e-1274-40b0-a04e-c406d5d421e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:50.909149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 281/570] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:50.909980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4498c-7cfe-42b5-8a8d-9c4bd4933007 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:50.968544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 290/571] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:50.969652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2787e-1274-40b0-a04e-c406d5d421e3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.011487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4498c-7cfe-42b5-8a8d-9c4bd4933007 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.026338 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:51.035608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:51.045924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089f20f-8f63-464a-bb9f-e120924fb82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.046727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089f20f-8f63-464a-bb9f-e120924fb82a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089f20f-8f63-464a-bb9f-e120924fb82a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089f20f-8f63-464a-bb9f-e120924fb82a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089f20f-8f63-464a-bb9f-e120924fb82a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d089f20f-8f63-464a-bb9f-e120924fb82a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:51.078580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:51.079230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:51.080689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:51.082137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:51.082137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:51.082137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:51.082137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 282/572] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:51.082373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2787e-1274-40b0-a04e-c406d5d421e3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.082446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089f20f-8f63-464a-bb9f-e120924fb82a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.105731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73f8fb-ab1d-44d7-9d86-8928a3951ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.105731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73f8fb-ab1d-44d7-9d86-8928a3951ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.105731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73f8fb-ab1d-44d7-9d86-8928a3951ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.105731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73f8fb-ab1d-44d7-9d86-8928a3951ca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.109495 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73f8fb-ab1d-44d7-9d86-8928a3951ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.110940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73f8fb-ab1d-44d7-9d86-8928a3951ca1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8b73f8fb-ab1d-44d7-9d86-8928a3951ca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:51.124733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:51.125851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:51.126727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:51.126727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:51.126727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:51.126727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:51.126727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:51.126727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:51.126727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:51.126727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:51.126727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 291/573] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:51.127396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73f8fb-ab1d-44d7-9d86-8928a3951ca1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.179431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089f20f-8f63-464a-bb9f-e120924fb82a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.213170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98977367-f78e-4568-bb3f-0fd4fdae16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.213826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977367-f78e-4568-bb3f-0fd4fdae16be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.214107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977367-f78e-4568-bb3f-0fd4fdae16be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.214385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98977367-f78e-4568-bb3f-0fd4fdae16be None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.215108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98977367-f78e-4568-bb3f-0fd4fdae16be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:51.215412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98977367-f78e-4568-bb3f-0fd4fdae16be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.216808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98977367-f78e-4568-bb3f-0fd4fdae16be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.227329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73f8fb-ab1d-44d7-9d86-8928a3951ca1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.229157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 283/574] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:51.229932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98977367-f78e-4568-bb3f-0fd4fdae16be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.257151 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:51.264283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:51.265560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a653a1f-10bf-45ad-a59b-c4ae49bfbc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.266406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a653a1f-10bf-45ad-a59b-c4ae49bfbc0e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.266681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a653a1f-10bf-45ad-a59b-c4ae49bfbc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.266954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a653a1f-10bf-45ad-a59b-c4ae49bfbc0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.274272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a653a1f-10bf-45ad-a59b-c4ae49bfbc0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.275714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a653a1f-10bf-45ad-a59b-c4ae49bfbc0e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-6a653a1f-10bf-45ad-a59b-c4ae49bfbc0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:51.289855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:51.290936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:51.291971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:51.291971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:51.291971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:51.291971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:51.291971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:51.291971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:51.291971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:51.291971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:51.292922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 292/575] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:51.293727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a653a1f-10bf-45ad-a59b-c4ae49bfbc0e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.327932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98977367-f78e-4568-bb3f-0fd4fdae16be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.362879 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8352c-0bf8-4bb4-8602-8dcaf0f29bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.363646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8352c-0bf8-4bb4-8602-8dcaf0f29bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.363974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8352c-0bf8-4bb4-8602-8dcaf0f29bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.364252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8352c-0bf8-4bb4-8602-8dcaf0f29bd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.374532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8352c-0bf8-4bb4-8602-8dcaf0f29bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-51c8352c-0bf8-4bb4-8602-8dcaf0f29bd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:51.382824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:51.383783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:51.384650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 284/576] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:51.385358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8352c-0bf8-4bb4-8602-8dcaf0f29bd6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.395293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a653a1f-10bf-45ad-a59b-c4ae49bfbc0e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.429278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140039b2-eeae-4352-86d8-d778f015257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.429941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140039b2-eeae-4352-86d8-d778f015257e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.430219 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140039b2-eeae-4352-86d8-d778f015257e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.430492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140039b2-eeae-4352-86d8-d778f015257e None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.431256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140039b2-eeae-4352-86d8-d778f015257e None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:51.431590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140039b2-eeae-4352-86d8-d778f015257e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.432994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140039b2-eeae-4352-86d8-d778f015257e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.441318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 293/577] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:51.442634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140039b2-eeae-4352-86d8-d778f015257e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.513650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:51.523901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:51.530401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8352c-0bf8-4bb4-8602-8dcaf0f29bd6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.564278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b004e03-2da0-43c9-9ae6-e8c89fead4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.564941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b004e03-2da0-43c9-9ae6-e8c89fead4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.565225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b004e03-2da0-43c9-9ae6-e8c89fead4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.565502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b004e03-2da0-43c9-9ae6-e8c89fead4e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.565606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140039b2-eeae-4352-86d8-d778f015257e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.566833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b004e03-2da0-43c9-9ae6-e8c89fead4e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:51.567145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b004e03-2da0-43c9-9ae6-e8c89fead4e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.568720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b004e03-2da0-43c9-9ae6-e8c89fead4e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.580540 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 285/578] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:51.581394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b004e03-2da0-43c9-9ae6-e8c89fead4e7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.605318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c878b5-384a-4bcd-a940-7d15a3fc324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.606112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c878b5-384a-4bcd-a940-7d15a3fc324a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.606388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c878b5-384a-4bcd-a940-7d15a3fc324a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.606661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c878b5-384a-4bcd-a940-7d15a3fc324a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.614517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c878b5-384a-4bcd-a940-7d15a3fc324a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.615921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c878b5-384a-4bcd-a940-7d15a3fc324a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b8c878b5-384a-4bcd-a940-7d15a3fc324a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:51.630614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:51.631549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:51.632511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 294/579] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:51.633078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c878b5-384a-4bcd-a940-7d15a3fc324a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.685539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b004e03-2da0-43c9-9ae6-e8c89fead4e7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.718104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850482a7-98a5-455e-92a8-09445f626a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.718761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850482a7-98a5-455e-92a8-09445f626a8d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.719041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850482a7-98a5-455e-92a8-09445f626a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.719313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850482a7-98a5-455e-92a8-09445f626a8d None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.720126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850482a7-98a5-455e-92a8-09445f626a8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:51.720435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850482a7-98a5-455e-92a8-09445f626a8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.721855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850482a7-98a5-455e-92a8-09445f626a8d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.730186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c878b5-384a-4bcd-a940-7d15a3fc324a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.733603 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 286/580] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:51.734370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850482a7-98a5-455e-92a8-09445f626a8d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.740600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:51.750914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:51.765108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8ecf-d0dc-4b35-a60e-ee3faeafd35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.765777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8ecf-d0dc-4b35-a60e-ee3faeafd35e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.766064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8ecf-d0dc-4b35-a60e-ee3faeafd35e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.766341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f8ecf-d0dc-4b35-a60e-ee3faeafd35e None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.767090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f8ecf-d0dc-4b35-a60e-ee3faeafd35e None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:51.767397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f8ecf-d0dc-4b35-a60e-ee3faeafd35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.768810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f8ecf-d0dc-4b35-a60e-ee3faeafd35e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.777522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 295/581] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:51.778325 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8ecf-d0dc-4b35-a60e-ee3faeafd35e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.837737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850482a7-98a5-455e-92a8-09445f626a8d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.872807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265850af-01a0-49b9-bb3e-df84a860ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.873604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265850af-01a0-49b9-bb3e-df84a860ad2c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.873954 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265850af-01a0-49b9-bb3e-df84a860ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.874233 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265850af-01a0-49b9-bb3e-df84a860ad2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.876053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f8ecf-d0dc-4b35-a60e-ee3faeafd35e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:51.886892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265850af-01a0-49b9-bb3e-df84a860ad2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.888368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265850af-01a0-49b9-bb3e-df84a860ad2c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-265850af-01a0-49b9-bb3e-df84a860ad2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:51.908830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:51.910899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:51.911853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:51.911853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:51.911853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:51.911853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:51.911853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 287/582] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:51.912639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265850af-01a0-49b9-bb3e-df84a860ad2c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.912961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f490af-79af-42bb-a99d-0bf389c8c16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:51.913842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f490af-79af-42bb-a99d-0bf389c8c16e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:51.914157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f490af-79af-42bb-a99d-0bf389c8c16e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:51.914434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f490af-79af-42bb-a99d-0bf389c8c16e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:51.915393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f490af-79af-42bb-a99d-0bf389c8c16e None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=66e90e70937d49c8a35928fcfc90972d) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:51.915702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f490af-79af-42bb-a99d-0bf389c8c16e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:51.917175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f490af-79af-42bb-a99d-0bf389c8c16e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:51.922800 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 296/583] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/role_assignments?user.id=66e90e70937d49c8a35928fcfc90972d&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:51.923541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f490af-79af-42bb-a99d-0bf389c8c16e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:51.960865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:51.998076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:52.040035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f490af-79af-42bb-a99d-0bf389c8c16e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:52.040396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265850af-01a0-49b9-bb3e-df84a860ad2c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:52.079362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9a439-6b33-4a39-9900-fb44d01161ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:52.080186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9a439-6b33-4a39-9900-fb44d01161ef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:52.080376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9a439-6b33-4a39-9900-fb44d01161ef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:52.080631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9a439-6b33-4a39-9900-fb44d01161ef None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:52.081874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9a439-6b33-4a39-9900-fb44d01161ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:52.081874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9a439-6b33-4a39-9900-fb44d01161ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:52.083316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9a439-6b33-4a39-9900-fb44d01161ef None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:52.085592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60450c-64ab-4104-b8cb-e4014f51b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:52.086608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60450c-64ab-4104-b8cb-e4014f51b38f None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:52.086886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60450c-64ab-4104-b8cb-e4014f51b38f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:52.087160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60450c-64ab-4104-b8cb-e4014f51b38f None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/fbfe6b7a82f746169a39976be263aa29/roles/4ebdbc7b2e0b4807a0ef679e0f061a53` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:52.103150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60450c-64ab-4104-b8cb-e4014f51b38f None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=fbfe6b7a82f746169a39976be263aa29, role_id=4ebdbc7b2e0b4807a0ef679e0f061a53)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:52.104637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60450c-64ab-4104-b8cb-e4014f51b38f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:52.106763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 288/584] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Jun 28 11:55:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:52.107456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9a439-6b33-4a39-9900-fb44d01161ef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:52.201897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 297/585] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:55:51 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/fbfe6b7a82f746169a39976be263aa29/roles/4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:52.203108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60450c-64ab-4104-b8cb-e4014f51b38f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:52.217585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9a439-6b33-4a39-9900-fb44d01161ef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:52.247823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:52.260687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412318f-bf88-4bf0-9ef9-deb661a2bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:52.267004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412318f-bf88-4bf0-9ef9-deb661a2bd8f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:52.267004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412318f-bf88-4bf0-9ef9-deb661a2bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:52.267004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412318f-bf88-4bf0-9ef9-deb661a2bd8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:52.274811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412318f-bf88-4bf0-9ef9-deb661a2bd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:52.276684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412318f-bf88-4bf0-9ef9-deb661a2bd8f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7412318f-bf88-4bf0-9ef9-deb661a2bd8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:52.301633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:52.302590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:52.303450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:52.303450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:52.303450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:52.303450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:52.303450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 289/586] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:52.304478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412318f-bf88-4bf0-9ef9-deb661a2bd8f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:52.315673 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:52.340971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60450c-64ab-4104-b8cb-e4014f51b38f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:52.381155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87dd5-86df-44be-8a1a-6048ce186dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:52.382300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87dd5-86df-44be-8a1a-6048ce186dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:52.382786 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87dd5-86df-44be-8a1a-6048ce186dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:52.383264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87dd5-86df-44be-8a1a-6048ce186dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:52.384814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c87dd5-86df-44be-8a1a-6048ce186dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:52.385334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c87dd5-86df-44be-8a1a-6048ce186dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:52.388612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c87dd5-86df-44be-8a1a-6048ce186dd5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:52.405273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 298/587] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:52.405876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87dd5-86df-44be-8a1a-6048ce186dd5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:52.447929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412318f-bf88-4bf0-9ef9-deb661a2bd8f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:52.482561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1907a5-0aea-434b-9d70-93667df85859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:52.483274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1907a5-0aea-434b-9d70-93667df85859 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:52.483560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1907a5-0aea-434b-9d70-93667df85859 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:52.483838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1907a5-0aea-434b-9d70-93667df85859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:52.494514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1907a5-0aea-434b-9d70-93667df85859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:52.495995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1907a5-0aea-434b-9d70-93667df85859 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1a1907a5-0aea-434b-9d70-93667df85859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:52.514218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:52.515145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:52.516052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:52.516052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:52.516052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:52.516052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:52.516052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 290/588] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:52.516471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1907a5-0aea-434b-9d70-93667df85859 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:52.552824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:52.592141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87dd5-86df-44be-8a1a-6048ce186dd5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:52.630369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1907a5-0aea-434b-9d70-93667df85859 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:52.638943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e799d02-4a6f-425d-80e6-835f42c813f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:52.640215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e799d02-4a6f-425d-80e6-835f42c813f0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:52.640671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e799d02-4a6f-425d-80e6-835f42c813f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:52.641085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e799d02-4a6f-425d-80e6-835f42c813f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:52.642279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e799d02-4a6f-425d-80e6-835f42c813f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:52.643061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e799d02-4a6f-425d-80e6-835f42c813f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:52.645033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e799d02-4a6f-425d-80e6-835f42c813f0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:52.661132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 299/589] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:52.662164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e799d02-4a6f-425d-80e6-835f42c813f0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:52.666064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:52.676764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483eb9d-2c85-41e8-84da-a1bec23d0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:52.677894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483eb9d-2c85-41e8-84da-a1bec23d0a48 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:52.678660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483eb9d-2c85-41e8-84da-a1bec23d0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:52.678660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483eb9d-2c85-41e8-84da-a1bec23d0a48 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:52.686422 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483eb9d-2c85-41e8-84da-a1bec23d0a48 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:52.688023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483eb9d-2c85-41e8-84da-a1bec23d0a48 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8483eb9d-2c85-41e8-84da-a1bec23d0a48 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:52.703958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:52.704974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 11:55:52.705968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:52.710533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 291/590] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:52.711560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483eb9d-2c85-41e8-84da-a1bec23d0a48 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:52.782096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e799d02-4a6f-425d-80e6-835f42c813f0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:52.820594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a3574-a260-4deb-a4e5-e4c41cd686f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:52.821586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a3574-a260-4deb-a4e5-e4c41cd686f5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:52.821746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a3574-a260-4deb-a4e5-e4c41cd686f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:52.822151 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a3574-a260-4deb-a4e5-e4c41cd686f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:52.822980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a3574-a260-4deb-a4e5-e4c41cd686f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:52.823426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a3574-a260-4deb-a4e5-e4c41cd686f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:52.824911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a3574-a260-4deb-a4e5-e4c41cd686f5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:52.826824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:52.842906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483eb9d-2c85-41e8-84da-a1bec23d0a48 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:52.843538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 300/591] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:52.844684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a3574-a260-4deb-a4e5-e4c41cd686f5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:52.888962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b072c-6f0d-4ac3-b688-3d692577a8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:52.889769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b072c-6f0d-4ac3-b688-3d692577a8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:52.890050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b072c-6f0d-4ac3-b688-3d692577a8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:52.890322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b072c-6f0d-4ac3-b688-3d692577a8b3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:52.901118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b072c-6f0d-4ac3-b688-3d692577a8b3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:52.902891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b072c-6f0d-4ac3-b688-3d692577a8b3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:52.917382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-671b072c-6f0d-4ac3-b688-3d692577a8b3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:52.926180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:52.931098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 292/592] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:52.932078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b072c-6f0d-4ac3-b688-3d692577a8b3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:52.963466 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a3574-a260-4deb-a4e5-e4c41cd686f5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.006821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954361a-524f-4106-9453-3fcc82fc0385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.007752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954361a-524f-4106-9453-3fcc82fc0385 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.008162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954361a-524f-4106-9453-3fcc82fc0385 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.008601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954361a-524f-4106-9453-3fcc82fc0385 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.009483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954361a-524f-4106-9453-3fcc82fc0385 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:53.009908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954361a-524f-4106-9453-3fcc82fc0385 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.011684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954361a-524f-4106-9453-3fcc82fc0385 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.036606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 301/593] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Jun 28 11:55:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:53.037746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954361a-524f-4106-9453-3fcc82fc0385 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.067111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b072c-6f0d-4ac3-b688-3d692577a8b3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.112949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c32024-41d8-4e52-823e-3504f360873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.114143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c32024-41d8-4e52-823e-3504f360873e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.114673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c32024-41d8-4e52-823e-3504f360873e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.115093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c32024-41d8-4e52-823e-3504f360873e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.123361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c32024-41d8-4e52-823e-3504f360873e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.125680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c32024-41d8-4e52-823e-3504f360873e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e4c32024-41d8-4e52-823e-3504f360873e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:53.143149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:53.144877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:53.145935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:53.145935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:53.145935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:53.145935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:53.145935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:53.145935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:53.145935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:53.145935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:53.148609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 293/594] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:53.149581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c32024-41d8-4e52-823e-3504f360873e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.150649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954361a-524f-4106-9453-3fcc82fc0385 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.162656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:53.177744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:53.191826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c89d-3aba-4fe5-987f-c28cffd70a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.192687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c89d-3aba-4fe5-987f-c28cffd70a67 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.193110 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c89d-3aba-4fe5-987f-c28cffd70a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.193790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29c89d-3aba-4fe5-987f-c28cffd70a67 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.195319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c89d-3aba-4fe5-987f-c28cffd70a67 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:53.195319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c89d-3aba-4fe5-987f-c28cffd70a67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.196964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29c89d-3aba-4fe5-987f-c28cffd70a67 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.220447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 302/595] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Jun 28 11:55:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:53.221418 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c89d-3aba-4fe5-987f-c28cffd70a67 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.271642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c32024-41d8-4e52-823e-3504f360873e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.308560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe085c8-8116-4f84-ad6d-10a8ef73ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.309409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe085c8-8116-4f84-ad6d-10a8ef73ec1a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.309839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe085c8-8116-4f84-ad6d-10a8ef73ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.310322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe085c8-8116-4f84-ad6d-10a8ef73ec1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.322176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe085c8-8116-4f84-ad6d-10a8ef73ec1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.323910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe085c8-8116-4f84-ad6d-10a8ef73ec1a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4fe085c8-8116-4f84-ad6d-10a8ef73ec1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:53.342779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:53.343701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:53.344684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:53.344684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:53.344684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:53.344684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:53.344684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 294/596] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:53.344963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe085c8-8116-4f84-ad6d-10a8ef73ec1a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.349812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29c89d-3aba-4fe5-987f-c28cffd70a67 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.388819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01266a19-8872-4c1a-970c-268fc1ae9a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.389604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01266a19-8872-4c1a-970c-268fc1ae9a1e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.389961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01266a19-8872-4c1a-970c-268fc1ae9a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.390310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01266a19-8872-4c1a-970c-268fc1ae9a1e None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.391301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01266a19-8872-4c1a-970c-268fc1ae9a1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:53.391904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01266a19-8872-4c1a-970c-268fc1ae9a1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.393478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01266a19-8872-4c1a-970c-268fc1ae9a1e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.408075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 303/597] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:53.409032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01266a19-8872-4c1a-970c-268fc1ae9a1e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.427085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:53.456737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:53.470555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe085c8-8116-4f84-ad6d-10a8ef73ec1a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.507326 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d00f0-8db3-433d-93dd-0512fda52f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.508317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d00f0-8db3-433d-93dd-0512fda52f1f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.508827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d00f0-8db3-433d-93dd-0512fda52f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.509125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d00f0-8db3-433d-93dd-0512fda52f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.520492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d00f0-8db3-433d-93dd-0512fda52f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.522067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d00f0-8db3-433d-93dd-0512fda52f1f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.525649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01266a19-8872-4c1a-970c-268fc1ae9a1e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3a0d00f0-8db3-433d-93dd-0512fda52f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:53.540731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:53.541930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:53.542861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:53.542861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:53.542861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:53.542861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:53.547504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 295/598] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:53.548475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d00f0-8db3-433d-93dd-0512fda52f1f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.568036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b57821-07e4-495e-8c6d-16a40ada7081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.569062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57821-07e4-495e-8c6d-16a40ada7081 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.569531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57821-07e4-495e-8c6d-16a40ada7081 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.570006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57821-07e4-495e-8c6d-16a40ada7081 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.570909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b57821-07e4-495e-8c6d-16a40ada7081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:53.571398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b57821-07e4-495e-8c6d-16a40ada7081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.573178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b57821-07e4-495e-8c6d-16a40ada7081 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.591401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 304/599] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:53.592640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b57821-07e4-495e-8c6d-16a40ada7081 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.651784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d00f0-8db3-433d-93dd-0512fda52f1f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.665481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:53.687239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c68d0d-436d-4a6a-a010-749a4ab904a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.688263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c68d0d-436d-4a6a-a010-749a4ab904a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.688615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c68d0d-436d-4a6a-a010-749a4ab904a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.688963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c68d0d-436d-4a6a-a010-749a4ab904a6 None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/6784d862961b44f48b385bec777ac439/roles/4ebdbc7b2e0b4807a0ef679e0f061a53` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.704727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c68d0d-436d-4a6a-a010-749a4ab904a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=6784d862961b44f48b385bec777ac439, role_id=4ebdbc7b2e0b4807a0ef679e0f061a53)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.705666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:53.706500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c68d0d-436d-4a6a-a010-749a4ab904a6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.710052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b57821-07e4-495e-8c6d-16a40ada7081 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.746057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823f44-f041-4509-81ed-c6a2bd69d343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.746748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823f44-f041-4509-81ed-c6a2bd69d343 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.747029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823f44-f041-4509-81ed-c6a2bd69d343 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.747300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf823f44-f041-4509-81ed-c6a2bd69d343 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.748058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823f44-f041-4509-81ed-c6a2bd69d343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:53.748363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823f44-f041-4509-81ed-c6a2bd69d343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.749730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf823f44-f041-4509-81ed-c6a2bd69d343 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.766038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 305/600] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:53.766038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823f44-f041-4509-81ed-c6a2bd69d343 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.773985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 296/601] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:55:53 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/6784d862961b44f48b385bec777ac439/roles/4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:53.774804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c68d0d-436d-4a6a-a010-749a4ab904a6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.908301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c68d0d-436d-4a6a-a010-749a4ab904a6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:53.950989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ee154-fe43-45e7-b850-53dde875da60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:53.952344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ee154-fe43-45e7-b850-53dde875da60 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:53.952859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ee154-fe43-45e7-b850-53dde875da60 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:53.953662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ee154-fe43-45e7-b850-53dde875da60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:53.963956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ee154-fe43-45e7-b850-53dde875da60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:53.966171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ee154-fe43-45e7-b850-53dde875da60 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-523ee154-fe43-45e7-b850-53dde875da60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:53.987063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:53.988230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:53.989090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:53.989090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:53.989090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:53.989090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:53.989090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:53.989090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:53.989090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:53.989090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:53.990255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 297/602] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:53.995955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ee154-fe43-45e7-b850-53dde875da60 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:53.998719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf823f44-f041-4509-81ed-c6a2bd69d343 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:54.035200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:54.039145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489730b3-3949-4376-b827-bba63264d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:54.040151 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489730b3-3949-4376-b827-bba63264d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.040417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489730b3-3949-4376-b827-bba63264d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.040766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489730b3-3949-4376-b827-bba63264d7a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.048828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489730b3-3949-4376-b827-bba63264d7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:54.050582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489730b3-3949-4376-b827-bba63264d7a9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-489730b3-3949-4376-b827-bba63264d7a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:54.065473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:54.066413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:54.067259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:54.067259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:54.067259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:54.067259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:54.067259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:54.067259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:54.067259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:54.067259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:54.071514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 306/603] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:54.072791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489730b3-3949-4376-b827-bba63264d7a9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:54.099019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:54.127000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ee154-fe43-45e7-b850-53dde875da60 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:54.164764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df01f8-67a9-4e29-8a5e-ef38db5c7e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:54.165393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df01f8-67a9-4e29-8a5e-ef38db5c7e0e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.165679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df01f8-67a9-4e29-8a5e-ef38db5c7e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.165952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df01f8-67a9-4e29-8a5e-ef38db5c7e0e None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.166743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df01f8-67a9-4e29-8a5e-ef38db5c7e0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:54.167060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df01f8-67a9-4e29-8a5e-ef38db5c7e0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:54.168537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df01f8-67a9-4e29-8a5e-ef38db5c7e0e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:54.179786 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489730b3-3949-4376-b827-bba63264d7a9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:54.180737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 298/604] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:54.182030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720de719-e3f7-445b-84d7-716b936b40e3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.182318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720de719-e3f7-445b-84d7-716b936b40e3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.182596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720de719-e3f7-445b-84d7-716b936b40e3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.184051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 299/605] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:54.188769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720de719-e3f7-445b-84d7-716b936b40e3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:54.219451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf315c4b-9792-4dc9-bd3a-6d6b98246426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:54.220587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315c4b-9792-4dc9-bd3a-6d6b98246426 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.221074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315c4b-9792-4dc9-bd3a-6d6b98246426 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.221635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315c4b-9792-4dc9-bd3a-6d6b98246426 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.223234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315c4b-9792-4dc9-bd3a-6d6b98246426 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:54.223762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315c4b-9792-4dc9-bd3a-6d6b98246426 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:54.225654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315c4b-9792-4dc9-bd3a-6d6b98246426 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:54.243780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 307/606] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:54.245473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8b1eb-d64c-43ef-b4cc-7f0ed46a178a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.245881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8b1eb-d64c-43ef-b4cc-7f0ed46a178a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.246259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8b1eb-d64c-43ef-b4cc-7f0ed46a178a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.265860 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-84d8b1eb-d64c-43ef-b4cc-7f0ed46a178a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:54.267311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-84d8b1eb-d64c-43ef-b4cc-7f0ed46a178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:54.279090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:54.301577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720de719-e3f7-445b-84d7-716b936b40e3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:54.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cab9f7-eafe-4518-8666-c7524cf8e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:54.349134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab9f7-eafe-4518-8666-c7524cf8e474 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.349421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab9f7-eafe-4518-8666-c7524cf8e474 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.349700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cab9f7-eafe-4518-8666-c7524cf8e474 None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/3ff61c1fbdf34fa38588e4cd2cdc5398/roles/4ebdbc7b2e0b4807a0ef679e0f061a53` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.355584 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 308/607] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:54.356722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8b1eb-d64c-43ef-b4cc-7f0ed46a178a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:54.369809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:54.370875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cab9f7-eafe-4518-8666-c7524cf8e474 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=3ff61c1fbdf34fa38588e4cd2cdc5398, role_id=4ebdbc7b2e0b4807a0ef679e0f061a53)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:54.372792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cab9f7-eafe-4518-8666-c7524cf8e474 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:54.459599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8b1eb-d64c-43ef-b4cc-7f0ed46a178a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:54.472156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 300/608] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:55:54 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/3ff61c1fbdf34fa38588e4cd2cdc5398/roles/4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:54.472156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9844b61-832e-48e8-8481-1705d462b819 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.472156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9844b61-832e-48e8-8481-1705d462b819 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.472156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9844b61-832e-48e8-8481-1705d462b819 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.472156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 301/609] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:54.472156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9844b61-832e-48e8-8481-1705d462b819 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:54.541107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f95537-ff75-4ec1-9543-2ad612d22f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:54.542346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f95537-ff75-4ec1-9543-2ad612d22f9a None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.542633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f95537-ff75-4ec1-9543-2ad612d22f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.543433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f95537-ff75-4ec1-9543-2ad612d22f9a None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/62bbcb039ed44749ab80bfc97dabd7b4/roles/4ebdbc7b2e0b4807a0ef679e0f061a53` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.571032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f95537-ff75-4ec1-9543-2ad612d22f9a None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=62bbcb039ed44749ab80bfc97dabd7b4, role_id=4ebdbc7b2e0b4807a0ef679e0f061a53)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:54.572899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f95537-ff75-4ec1-9543-2ad612d22f9a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:54.597577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9844b61-832e-48e8-8481-1705d462b819 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:54.632936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:54.642823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 309/610] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:55:54 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/62bbcb039ed44749ab80bfc97dabd7b4/roles/4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:54.645074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279ee2-629a-4454-a57c-3a8f9e10d830 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.645074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279ee2-629a-4454-a57c-3a8f9e10d830 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.645074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279ee2-629a-4454-a57c-3a8f9e10d830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.651651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb18e3b-8ec8-43d8-a501-78b73a112266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:54.652509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb18e3b-8ec8-43d8-a501-78b73a112266 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.652792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb18e3b-8ec8-43d8-a501-78b73a112266 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.653065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb18e3b-8ec8-43d8-a501-78b73a112266 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.669542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-af279ee2-629a-4454-a57c-3a8f9e10d830 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:54.670569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb18e3b-8ec8-43d8-a501-78b73a112266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:54.671429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-af279ee2-629a-4454-a57c-3a8f9e10d830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-abb18e3b-8ec8-43d8-a501-78b73a112266 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:54.679297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:54.680366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:54.681261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 302/611] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:54.689260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb18e3b-8ec8-43d8-a501-78b73a112266 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:54.747485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:54.763697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 310/612] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:54.792350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af279ee2-629a-4454-a57c-3a8f9e10d830 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:54.888348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb18e3b-8ec8-43d8-a501-78b73a112266 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:54.935007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af279ee2-629a-4454-a57c-3a8f9e10d830 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:54.947709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7b385-2d55-473c-a419-949b0d613cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:54.948427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7b385-2d55-473c-a419-949b0d613cda None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:54.948713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7b385-2d55-473c-a419-949b0d613cda None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:54.948992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7b385-2d55-473c-a419-949b0d613cda None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:54.949763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7b385-2d55-473c-a419-949b0d613cda None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:54.950072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7b385-2d55-473c-a419-949b0d613cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:54.951452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7b385-2d55-473c-a419-949b0d613cda None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:54.972609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 303/613] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:54.976521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7b385-2d55-473c-a419-949b0d613cda None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:55.005184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7a837-7d19-4f46-9330-0916b92d5a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:55.005914 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7a837-7d19-4f46-9330-0916b92d5a0d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:55.006200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7a837-7d19-4f46-9330-0916b92d5a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:55.006476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7a837-7d19-4f46-9330-0916b92d5a0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:55.025997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7a837-7d19-4f46-9330-0916b92d5a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0de7a837-7d19-4f46-9330-0916b92d5a0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:55.044469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:55.045630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:55.046624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:55.047902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 311/614] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:55.058095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7a837-7d19-4f46-9330-0916b92d5a0d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:55.075686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:55.148239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:55.155703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7b385-2d55-473c-a419-949b0d613cda None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:55.221353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45866e8-95b8-48a9-aa11-2e6b1951f2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:55.222725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45866e8-95b8-48a9-aa11-2e6b1951f2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:55.223010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45866e8-95b8-48a9-aa11-2e6b1951f2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:55.223294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45866e8-95b8-48a9-aa11-2e6b1951f2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:55.237183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45866e8-95b8-48a9-aa11-2e6b1951f2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:55.238845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45866e8-95b8-48a9-aa11-2e6b1951f2a7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:55.241460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7a837-7d19-4f46-9330-0916b92d5a0d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c45866e8-95b8-48a9-aa11-2e6b1951f2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:55.257676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:55.258572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:55.259470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:55.259470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:55.259470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:55.259470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:55.261724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 304/615] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:55.273032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45866e8-95b8-48a9-aa11-2e6b1951f2a7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:55.277114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adf26b-ec41-4207-b867-db1a76b780b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:55.277783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adf26b-ec41-4207-b867-db1a76b780b4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:55.278121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adf26b-ec41-4207-b867-db1a76b780b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:55.278396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adf26b-ec41-4207-b867-db1a76b780b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:55.279191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adf26b-ec41-4207-b867-db1a76b780b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:55.279502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adf26b-ec41-4207-b867-db1a76b780b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:55.280938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adf26b-ec41-4207-b867-db1a76b780b4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:55.289669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 312/616] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:55.295009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adf26b-ec41-4207-b867-db1a76b780b4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:55.398359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adf26b-ec41-4207-b867-db1a76b780b4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:55.411303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:55.438552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd747a-eed4-4855-86fa-6e17577520b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:55.439366 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd747a-eed4-4855-86fa-6e17577520b2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:55.439644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd747a-eed4-4855-86fa-6e17577520b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:55.439949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd747a-eed4-4855-86fa-6e17577520b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:55.457742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd747a-eed4-4855-86fa-6e17577520b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:55.460190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd747a-eed4-4855-86fa-6e17577520b2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:55.479671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45866e8-95b8-48a9-aa11-2e6b1951f2a7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:55.492423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-cafd747a-eed4-4855-86fa-6e17577520b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:55.494155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:55.495005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:55.495889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:55.495889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:55.495889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:55.495889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:55.497116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 313/617] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:55.504705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd747a-eed4-4855-86fa-6e17577520b2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:55.552549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35117-d4b5-4a52-aeb0-bfba14827305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:55.553215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35117-d4b5-4a52-aeb0-bfba14827305 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:55.553500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35117-d4b5-4a52-aeb0-bfba14827305 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:55.554340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c35117-d4b5-4a52-aeb0-bfba14827305 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:55.555836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35117-d4b5-4a52-aeb0-bfba14827305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:55.556177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35117-d4b5-4a52-aeb0-bfba14827305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:55.557659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c35117-d4b5-4a52-aeb0-bfba14827305 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:55.585871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 305/618] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:55.589187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35117-d4b5-4a52-aeb0-bfba14827305 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:55.698558 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd747a-eed4-4855-86fa-6e17577520b2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:55.735607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289e349-7c96-47e4-8206-886807961b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:55.736302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289e349-7c96-47e4-8206-886807961b6d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:55.736583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289e349-7c96-47e4-8206-886807961b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:55.736857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289e349-7c96-47e4-8206-886807961b6d None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:55.738407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289e349-7c96-47e4-8206-886807961b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:55.738718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289e349-7c96-47e4-8206-886807961b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:55.740115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289e349-7c96-47e4-8206-886807961b6d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:55.754306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 314/619] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:55.759556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289e349-7c96-47e4-8206-886807961b6d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:55.787613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:55.818056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c35117-d4b5-4a52-aeb0-bfba14827305 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:55.865710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289e349-7c96-47e4-8206-886807961b6d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:55.901676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc47f3-0218-41cb-898a-b00f2deeecb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:55.902905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc47f3-0218-41cb-898a-b00f2deeecb6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:55.903450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc47f3-0218-41cb-898a-b00f2deeecb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:55.903986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc47f3-0218-41cb-898a-b00f2deeecb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:55.912314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc47f3-0218-41cb-898a-b00f2deeecb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:55.912574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c829-82fd-49c7-9ce4-2f11340042f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:55.913388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c829-82fd-49c7-9ce4-2f11340042f5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:55.913675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c829-82fd-49c7-9ce4-2f11340042f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:55.913956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c829-82fd-49c7-9ce4-2f11340042f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:55.914860 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc47f3-0218-41cb-898a-b00f2deeecb6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e1cc47f3-0218-41cb-898a-b00f2deeecb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:55.930337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:55.931380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:55:55.932338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:55.935003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 315/620] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Jun 28 11:55:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:55:55.940643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc47f3-0218-41cb-898a-b00f2deeecb6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:55.940879 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c829-82fd-49c7-9ce4-2f11340042f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:55.942535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c829-82fd-49c7-9ce4-2f11340042f5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7b73c829-82fd-49c7-9ce4-2f11340042f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:55.981406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:55.982536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:55:55.983493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:55.992324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 306/621] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:55:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:55.997787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c829-82fd-49c7-9ce4-2f11340042f5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:56.042629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:56.054251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc47f3-0218-41cb-898a-b00f2deeecb6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:56.072240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:56.089163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ce0cb-824e-47a2-b9fa-b53b72c0bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:56.095579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ce0cb-824e-47a2-b9fa-b53b72c0bfdf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:56.095579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ce0cb-824e-47a2-b9fa-b53b72c0bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:56.095579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ce0cb-824e-47a2-b9fa-b53b72c0bfdf None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:56.095579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ce0cb-824e-47a2-b9fa-b53b72c0bfdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:56.095579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ce0cb-824e-47a2-b9fa-b53b72c0bfdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:56.095579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ce0cb-824e-47a2-b9fa-b53b72c0bfdf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:56.113076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 316/622] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Jun 28 11:55:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:56.118403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ce0cb-824e-47a2-b9fa-b53b72c0bfdf None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:56.184983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c829-82fd-49c7-9ce4-2f11340042f5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:56.236705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47564058-afe4-458c-9dd0-a609aee8350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:56.237417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47564058-afe4-458c-9dd0-a609aee8350a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:56.237698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47564058-afe4-458c-9dd0-a609aee8350a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:56.237972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47564058-afe4-458c-9dd0-a609aee8350a None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:56.238818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47564058-afe4-458c-9dd0-a609aee8350a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:56.239127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47564058-afe4-458c-9dd0-a609aee8350a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:56.243620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47564058-afe4-458c-9dd0-a609aee8350a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:56.274559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 307/623] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Jun 28 11:55:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:55:56.279817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47564058-afe4-458c-9dd0-a609aee8350a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:56.285784 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ce0cb-824e-47a2-b9fa-b53b72c0bfdf None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:56.339467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e352c58-3707-4f9e-a0b7-4a9934878380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:56.340299 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352c58-3707-4f9e-a0b7-4a9934878380 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:56.340585 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352c58-3707-4f9e-a0b7-4a9934878380 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:56.340856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352c58-3707-4f9e-a0b7-4a9934878380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:56.364290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:56.366647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:56.388023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47564058-afe4-458c-9dd0-a609aee8350a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:56.426563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73616419-d510-4666-8cc3-7472d3e5b327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:56.427475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616419-d510-4666-8cc3-7472d3e5b327 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:56.427836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616419-d510-4666-8cc3-7472d3e5b327 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:56.428290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73616419-d510-4666-8cc3-7472d3e5b327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:56.439587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73616419-d510-4666-8cc3-7472d3e5b327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:56.440115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352c58-3707-4f9e-a0b7-4a9934878380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:56.441746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73616419-d510-4666-8cc3-7472d3e5b327 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:56.442292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352c58-3707-4f9e-a0b7-4a9934878380 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-73616419-d510-4666-8cc3-7472d3e5b327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:56.462091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:56.463059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:56.463965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:56.463965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:56.463965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:56.463965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:56.463965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 308/624] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:56.469913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb34f9-1aaf-4c7d-9704-fb7e7096a10d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:56.470400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb34f9-1aaf-4c7d-9704-fb7e7096a10d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:56.470745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb34f9-1aaf-4c7d-9704-fb7e7096a10d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:56.473361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 309/625] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:56.474230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb34f9-1aaf-4c7d-9704-fb7e7096a10d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:56.575706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 317/626] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 11:55:56.577152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3a1fb-33f5-4409-98bc-85dac3ac7d06 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:56.577441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3a1fb-33f5-4409-98bc-85dac3ac7d06 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:56.577720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3a1fb-33f5-4409-98bc-85dac3ac7d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:56.593641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb34f9-1aaf-4c7d-9704-fb7e7096a10d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:56.598864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fbd3a1fb-33f5-4409-98bc-85dac3ac7d06 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:56.600102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fbd3a1fb-33f5-4409-98bc-85dac3ac7d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:56.632724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035ab36-3ce3-42ce-b7a6-10fc530eb8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:56.633693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035ab36-3ce3-42ce-b7a6-10fc530eb8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:56.634051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035ab36-3ce3-42ce-b7a6-10fc530eb8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:56.634400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035ab36-3ce3-42ce-b7a6-10fc530eb8a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:56.635204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035ab36-3ce3-42ce-b7a6-10fc530eb8a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:56.635600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035ab36-3ce3-42ce-b7a6-10fc530eb8a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:56.637247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035ab36-3ce3-42ce-b7a6-10fc530eb8a0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:56.639898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:56.643042 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:56.656385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 310/627] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:56.663320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035ab36-3ce3-42ce-b7a6-10fc530eb8a0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:56.687956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 318/628] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:56.689072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3a1fb-33f5-4409-98bc-85dac3ac7d06 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:56.786048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035ab36-3ce3-42ce-b7a6-10fc530eb8a0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:56.807736 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3a1fb-33f5-4409-98bc-85dac3ac7d06 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:56.824364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56676df9-9046-4aa4-909b-22e5f34cd21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:56.825583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56676df9-9046-4aa4-909b-22e5f34cd21d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:56.826015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56676df9-9046-4aa4-909b-22e5f34cd21d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:56.826448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56676df9-9046-4aa4-909b-22e5f34cd21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:56.838425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56676df9-9046-4aa4-909b-22e5f34cd21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:56.840100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56676df9-9046-4aa4-909b-22e5f34cd21d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:56.842780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc0dcb-3ccc-4dfd-bb54-3c2d274ff8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:56.843626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc0dcb-3ccc-4dfd-bb54-3c2d274ff8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:56.843999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc0dcb-3ccc-4dfd-bb54-3c2d274ff8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:56.844274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc0dcb-3ccc-4dfd-bb54-3c2d274ff8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:56.852410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc0dcb-3ccc-4dfd-bb54-3c2d274ff8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:56.853924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc0dcb-3ccc-4dfd-bb54-3c2d274ff8b8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-56676df9-9046-4aa4-909b-22e5f34cd21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:56.860210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:56.861310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:56.863038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:56.863038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:56.863038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:56.863038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:56.864993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 311/629] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:56.865941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56676df9-9046-4aa4-909b-22e5f34cd21d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-81cc0dcb-3ccc-4dfd-bb54-3c2d274ff8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:56.869590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:56.870651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:56.871677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:56.871677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:56.871677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:56.871677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:56.871677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:56.871677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:56.871677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:56.871677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:56.875479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 319/630] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:56.876415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc0dcb-3ccc-4dfd-bb54-3c2d274ff8b8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:56.909953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:56.925560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:56.981225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc0dcb-3ccc-4dfd-bb54-3c2d274ff8b8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:56.983019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56676df9-9046-4aa4-909b-22e5f34cd21d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.015978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad364694-1a87-4b86-863f-e43f827f0363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.016648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad364694-1a87-4b86-863f-e43f827f0363 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.016930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad364694-1a87-4b86-863f-e43f827f0363 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.017210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad364694-1a87-4b86-863f-e43f827f0363 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.017936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad364694-1a87-4b86-863f-e43f827f0363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:57.018248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad364694-1a87-4b86-863f-e43f827f0363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:57.019713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad364694-1a87-4b86-863f-e43f827f0363 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:57.021983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f4391-1be5-4166-a62c-c7f7e44de99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.022915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f4391-1be5-4166-a62c-c7f7e44de99b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.023209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f4391-1be5-4166-a62c-c7f7e44de99b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.023489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f4391-1be5-4166-a62c-c7f7e44de99b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.031633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 320/631] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:57.034730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad364694-1a87-4b86-863f-e43f827f0363 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.035024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f4391-1be5-4166-a62c-c7f7e44de99b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2f7f4391-1be5-4166-a62c-c7f7e44de99b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:57.042925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:57.044119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 312/632] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:57.050434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b161f-a34f-43e0-a781-2211f207027c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.051281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b161f-a34f-43e0-a781-2211f207027c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.051281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b161f-a34f-43e0-a781-2211f207027c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.051281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 313/633] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:57.051281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c04233-78a3-4783-8fec-e9ac168b26c8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.051281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c04233-78a3-4783-8fec-e9ac168b26c8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.051281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c04233-78a3-4783-8fec-e9ac168b26c8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.051281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 314/634] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:57.051851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c04233-78a3-4783-8fec-e9ac168b26c8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.130920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:57.139138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad364694-1a87-4b86-863f-e43f827f0363 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.151820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c04233-78a3-4783-8fec-e9ac168b26c8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.161047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:57.173082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b274-d695-475a-ac84-a2ce4f1ebfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.173743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b274-d695-475a-ac84-a2ce4f1ebfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.174025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b274-d695-475a-ac84-a2ce4f1ebfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.174301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b274-d695-475a-ac84-a2ce4f1ebfb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.175804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b274-d695-475a-ac84-a2ce4f1ebfb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:57.176139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b274-d695-475a-ac84-a2ce4f1ebfb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:57.177582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b274-d695-475a-ac84-a2ce4f1ebfb7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:57.186807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb33567-51ad-4bbd-b596-f836e7107f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.187602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb33567-51ad-4bbd-b596-f836e7107f86 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.187894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb33567-51ad-4bbd-b596-f836e7107f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.188189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb33567-51ad-4bbd-b596-f836e7107f86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.189213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 321/635] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:57.190018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b274-d695-475a-ac84-a2ce4f1ebfb7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.200418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb33567-51ad-4bbd-b596-f836e7107f86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:57.201866 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb33567-51ad-4bbd-b596-f836e7107f86 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8eb33567-51ad-4bbd-b596-f836e7107f86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:55:57.215952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:57.217030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:57.217931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:55:57.217931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:55:57.217931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:55:57.217931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:55:57.217931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:55:57.217931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:55:57.217931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:55:57.217931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:57.217931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 315/636] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:57.218445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5f5c-9328-49ab-a266-5b985126acb4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.218590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5f5c-9328-49ab-a266-5b985126acb4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.218920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5f5c-9328-49ab-a266-5b985126acb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.234959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-889f5f5c-9328-49ab-a266-5b985126acb4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:57.236171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-889f5f5c-9328-49ab-a266-5b985126acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:57.295413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b274-d695-475a-ac84-a2ce4f1ebfb7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.302746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 316/637] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:57.304044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5469ac7-1712-4a36-a9a3-5de20c459319 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.304337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5469ac7-1712-4a36-a9a3-5de20c459319 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.304619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5469ac7-1712-4a36-a9a3-5de20c459319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.320233 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e5469ac7-1712-4a36-a9a3-5de20c459319 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:55:57.321424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e5469ac7-1712-4a36-a9a3-5de20c459319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:55:57.344802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8512d28-62bb-418d-93bc-bdba0a19daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.345469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512d28-62bb-418d-93bc-bdba0a19daee None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.345749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512d28-62bb-418d-93bc-bdba0a19daee None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.346031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512d28-62bb-418d-93bc-bdba0a19daee None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.347335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8512d28-62bb-418d-93bc-bdba0a19daee None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:57.347622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8512d28-62bb-418d-93bc-bdba0a19daee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:57.349190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8512d28-62bb-418d-93bc-bdba0a19daee None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:57.357310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 322/638] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:57.358074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8512d28-62bb-418d-93bc-bdba0a19daee None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.375570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:57.389544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 317/639] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:55:57.389544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5469ac7-1712-4a36-a9a3-5de20c459319 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.418260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:57.460855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8512d28-62bb-418d-93bc-bdba0a19daee None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.489369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5469ac7-1712-4a36-a9a3-5de20c459319 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.494307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84e50c-564a-4c89-b2d3-b21fc3fa0333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.495201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84e50c-564a-4c89-b2d3-b21fc3fa0333 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.495483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84e50c-564a-4c89-b2d3-b21fc3fa0333 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.495759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84e50c-564a-4c89-b2d3-b21fc3fa0333 None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/66e90e70937d49c8a35928fcfc90972d/roles/4ebdbc7b2e0b4807a0ef679e0f061a53` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.511563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84e50c-564a-4c89-b2d3-b21fc3fa0333 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=66e90e70937d49c8a35928fcfc90972d, role_id=4ebdbc7b2e0b4807a0ef679e0f061a53)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:57.513060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84e50c-564a-4c89-b2d3-b21fc3fa0333 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:57.528235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c8a55-0278-45f6-a18d-13feef7cd4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.532607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c8a55-0278-45f6-a18d-13feef7cd4ae None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.532607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c8a55-0278-45f6-a18d-13feef7cd4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.532607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c8a55-0278-45f6-a18d-13feef7cd4ae None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.532607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c8a55-0278-45f6-a18d-13feef7cd4ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:57.532607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c8a55-0278-45f6-a18d-13feef7cd4ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:57.532607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c8a55-0278-45f6-a18d-13feef7cd4ae None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:57.543433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 318/640] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:57.544254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c8a55-0278-45f6-a18d-13feef7cd4ae None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.613128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 323/641] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:55:57 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/66e90e70937d49c8a35928fcfc90972d/roles/4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:55:57.614064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84e50c-564a-4c89-b2d3-b21fc3fa0333 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.638818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:57.656070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c8a55-0278-45f6-a18d-13feef7cd4ae None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.689350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:57.695305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316768f6-d551-4081-8ebd-5e38271701c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.697934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316768f6-d551-4081-8ebd-5e38271701c6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.697934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316768f6-d551-4081-8ebd-5e38271701c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.697934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316768f6-d551-4081-8ebd-5e38271701c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.709768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316768f6-d551-4081-8ebd-5e38271701c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-316768f6-d551-4081-8ebd-5e38271701c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:57.717885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:57.718899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:57.719774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 319/642] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:57.720520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316768f6-d551-4081-8ebd-5e38271701c6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.737053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84e50c-564a-4c89-b2d3-b21fc3fa0333 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.780296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2513752-dd87-4afc-9962-bee638b1eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.781098 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2513752-dd87-4afc-9962-bee638b1eaaf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.781406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2513752-dd87-4afc-9962-bee638b1eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.781654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2513752-dd87-4afc-9962-bee638b1eaaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.792686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2513752-dd87-4afc-9962-bee638b1eaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:57.794214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2513752-dd87-4afc-9962-bee638b1eaaf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f2513752-dd87-4afc-9962-bee638b1eaaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:57.812556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:57.813544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:57.814437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:57.814437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:57.814437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:57.814437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:57.814437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 324/643] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:57.814727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2513752-dd87-4afc-9962-bee638b1eaaf None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.847665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316768f6-d551-4081-8ebd-5e38271701c6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.887838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73013ee-3b36-4440-8d36-f978d664ea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.888768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73013ee-3b36-4440-8d36-f978d664ea83 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.889057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73013ee-3b36-4440-8d36-f978d664ea83 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.889336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73013ee-3b36-4440-8d36-f978d664ea83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.900624 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73013ee-3b36-4440-8d36-f978d664ea83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a73013ee-3b36-4440-8d36-f978d664ea83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:55:57.909112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:57.910418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:57.911287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 320/644] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:57.912127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73013ee-3b36-4440-8d36-f978d664ea83 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:57.924320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:57.933702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2513752-dd87-4afc-9962-bee638b1eaaf None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:57.951865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:57.970110 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ccaa1-8bb2-455d-90ee-17f9f56f8d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:57.970827 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ccaa1-8bb2-455d-90ee-17f9f56f8d1f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:57.971114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ccaa1-8bb2-455d-90ee-17f9f56f8d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:57.971403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ccaa1-8bb2-455d-90ee-17f9f56f8d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:57.972612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ccaa1-8bb2-455d-90ee-17f9f56f8d1f None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=fbfe6b7a82f746169a39976be263aa29) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:57.972853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ccaa1-8bb2-455d-90ee-17f9f56f8d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:57.974321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ccaa1-8bb2-455d-90ee-17f9f56f8d1f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:57.980630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 325/645] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/role_assignments?user.id=fbfe6b7a82f746169a39976be263aa29&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:57.988955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ccaa1-8bb2-455d-90ee-17f9f56f8d1f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.023602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73013ee-3b36-4440-8d36-f978d664ea83 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.072419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c631-9211-435d-8c91-c407d443ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:58.073967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c631-9211-435d-8c91-c407d443ba3d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:58.074731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c631-9211-435d-8c91-c407d443ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:58.075222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602c631-9211-435d-8c91-c407d443ba3d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:58.076269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602c631-9211-435d-8c91-c407d443ba3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:58.076797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602c631-9211-435d-8c91-c407d443ba3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:58.078623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602c631-9211-435d-8c91-c407d443ba3d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:58.092559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 321/646] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:58.092559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c631-9211-435d-8c91-c407d443ba3d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.127093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ccaa1-8bb2-455d-90ee-17f9f56f8d1f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.174016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427acbd-c8d4-4c0f-acda-3b28c8efd5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:58.175766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427acbd-c8d4-4c0f-acda-3b28c8efd5ba None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:58.176264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427acbd-c8d4-4c0f-acda-3b28c8efd5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:58.176968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:58.177365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427acbd-c8d4-4c0f-acda-3b28c8efd5ba None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:58.178893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427acbd-c8d4-4c0f-acda-3b28c8efd5ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:58.179208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427acbd-c8d4-4c0f-acda-3b28c8efd5ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:58.180633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427acbd-c8d4-4c0f-acda-3b28c8efd5ba None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:58.194300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 326/647] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:58.194300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427acbd-c8d4-4c0f-acda-3b28c8efd5ba None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.215296 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602c631-9211-435d-8c91-c407d443ba3d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.248881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:58.262954 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323562a-a09c-493e-b7fd-0cce2b7be84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:58.263636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323562a-a09c-493e-b7fd-0cce2b7be84e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:58.263979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323562a-a09c-493e-b7fd-0cce2b7be84e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:58.264268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323562a-a09c-493e-b7fd-0cce2b7be84e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:58.265037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323562a-a09c-493e-b7fd-0cce2b7be84e None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:58.265386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323562a-a09c-493e-b7fd-0cce2b7be84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:58.266771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323562a-a09c-493e-b7fd-0cce2b7be84e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:58.277515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 322/648] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:55:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:58.278449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323562a-a09c-493e-b7fd-0cce2b7be84e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.324902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427acbd-c8d4-4c0f-acda-3b28c8efd5ba None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.376840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550348-c391-4338-a89e-7b9803cd8b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:58.378165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550348-c391-4338-a89e-7b9803cd8b7d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:58.378617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550348-c391-4338-a89e-7b9803cd8b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:58.378886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550348-c391-4338-a89e-7b9803cd8b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:58.392791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323562a-a09c-493e-b7fd-0cce2b7be84e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.393413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f550348-c391-4338-a89e-7b9803cd8b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:58.395738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f550348-c391-4338-a89e-7b9803cd8b7d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-4f550348-c391-4338-a89e-7b9803cd8b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:58.420581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:58.421496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:58.422358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:58.422358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:58.422358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:58.422358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:58.424295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 327/649] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:58.424295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550348-c391-4338-a89e-7b9803cd8b7d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.426422 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:58.432228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2def114-f250-4813-997a-72b41f96a3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:58.433231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def114-f250-4813-997a-72b41f96a3cd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:58.433611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def114-f250-4813-997a-72b41f96a3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:58.433950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def114-f250-4813-997a-72b41f96a3cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:58.442381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2def114-f250-4813-997a-72b41f96a3cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:58.444004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2def114-f250-4813-997a-72b41f96a3cd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e2def114-f250-4813-997a-72b41f96a3cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:58.461505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:58.468327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 323/650] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:58.469256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2def114-f250-4813-997a-72b41f96a3cd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.558020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:58.570442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550348-c391-4338-a89e-7b9803cd8b7d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.577675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2def114-f250-4813-997a-72b41f96a3cd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.616947 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7fbe3-5b01-4cdc-8938-6a238eacac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:58.617549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ab54d-2e49-49c2-aebe-2961f1f72bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:58.618352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ab54d-2e49-49c2-aebe-2961f1f72bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:58.618641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ab54d-2e49-49c2-aebe-2961f1f72bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:58.618920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ab54d-2e49-49c2-aebe-2961f1f72bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:58.619188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7fbe3-5b01-4cdc-8938-6a238eacac00 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:58.619843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7fbe3-5b01-4cdc-8938-6a238eacac00 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:58.620354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7fbe3-5b01-4cdc-8938-6a238eacac00 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:58.621389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7fbe3-5b01-4cdc-8938-6a238eacac00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:58.621942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7fbe3-5b01-4cdc-8938-6a238eacac00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:58.623772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7fbe3-5b01-4cdc-8938-6a238eacac00 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:58.630652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ab54d-2e49-49c2-aebe-2961f1f72bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:58.632729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ab54d-2e49-49c2-aebe-2961f1f72bb1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:58.638438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 324/651] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:58.639543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7fbe3-5b01-4cdc-8938-6a238eacac00 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-943ab54d-2e49-49c2-aebe-2961f1f72bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:58.655549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:58.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:58.657354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:58.657354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:58.657354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:58.657354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:58.659948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 328/652] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:58.660985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ab54d-2e49-49c2-aebe-2961f1f72bb1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.717260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:58.769200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ab54d-2e49-49c2-aebe-2961f1f72bb1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.784007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7fbe3-5b01-4cdc-8938-6a238eacac00 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.817136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6c6d5-45fc-4966-8927-8a5620863ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:58.817957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c6d5-45fc-4966-8927-8a5620863ddc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:58.818246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c6d5-45fc-4966-8927-8a5620863ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:58.818528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c6d5-45fc-4966-8927-8a5620863ddc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:58.824981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2029195-5afb-49a2-b0a3-32bdae165dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:58.825960 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2029195-5afb-49a2-b0a3-32bdae165dbb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:58.826438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2029195-5afb-49a2-b0a3-32bdae165dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:58.826917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2029195-5afb-49a2-b0a3-32bdae165dbb None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:58.827405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6c6d5-45fc-4966-8927-8a5620863ddc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:58.828273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2029195-5afb-49a2-b0a3-32bdae165dbb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:58.828796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2029195-5afb-49a2-b0a3-32bdae165dbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:58.828898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6c6d5-45fc-4966-8927-8a5620863ddc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:58.830694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2029195-5afb-49a2-b0a3-32bdae165dbb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-98b6c6d5-45fc-4966-8927-8a5620863ddc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:58.847781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:58.848850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:58.849781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 329/653] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:55:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:58.850363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6c6d5-45fc-4966-8927-8a5620863ddc None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.857793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:58.858183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 325/654] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Jun 28 11:55:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:58.859407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2029195-5afb-49a2-b0a3-32bdae165dbb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:58.970882 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6c6d5-45fc-4966-8927-8a5620863ddc None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:58.990091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2029195-5afb-49a2-b0a3-32bdae165dbb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:59.001110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:59.018247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563beb99-ec28-407f-808c-b2dcfc0c2f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:59.020227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563beb99-ec28-407f-808c-b2dcfc0c2f08 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.020689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563beb99-ec28-407f-808c-b2dcfc0c2f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.020982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563beb99-ec28-407f-808c-b2dcfc0c2f08 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.022085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563beb99-ec28-407f-808c-b2dcfc0c2f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:59.022404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563beb99-ec28-407f-808c-b2dcfc0c2f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:59.024278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563beb99-ec28-407f-808c-b2dcfc0c2f08 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:59.030088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc873-d901-4e89-ae57-8294192d9ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:59.031002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc873-d901-4e89-ae57-8294192d9ded None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.031480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc873-d901-4e89-ae57-8294192d9ded None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.031986 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc873-d901-4e89-ae57-8294192d9ded None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.033036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc873-d901-4e89-ae57-8294192d9ded None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:59.033561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc873-d901-4e89-ae57-8294192d9ded None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:59.036090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc873-d901-4e89-ae57-8294192d9ded None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:59.038192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 330/655] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:59.040620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563beb99-ec28-407f-808c-b2dcfc0c2f08 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:59.067051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 326/656] 10.222.0.49 () {56 vars in 1139 bytes} [Tue Jun 28 11:55:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:59.067051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc873-d901-4e89-ae57-8294192d9ded None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:59.122162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:59.167687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563beb99-ec28-407f-808c-b2dcfc0c2f08 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:59.183495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc873-d901-4e89-ae57-8294192d9ded None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:59.204999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba57354-6013-4114-8ebe-8383e1424a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:59.206756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba57354-6013-4114-8ebe-8383e1424a8c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.207271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba57354-6013-4114-8ebe-8383e1424a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.207746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba57354-6013-4114-8ebe-8383e1424a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.228948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d6be-7b27-442b-8cac-41e898ba6ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:59.229682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d6be-7b27-442b-8cac-41e898ba6ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.229971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d6be-7b27-442b-8cac-41e898ba6ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.230276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d6be-7b27-442b-8cac-41e898ba6ce7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.240341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d6be-7b27-442b-8cac-41e898ba6ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:59.242414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d6be-7b27-442b-8cac-41e898ba6ce7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d3e9d6be-7b27-442b-8cac-41e898ba6ce7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:55:59.267839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:59.269440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 11:55:59.270360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:55:59.274568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 327/657] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:55:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:59.275718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d6be-7b27-442b-8cac-41e898ba6ce7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:59.293524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba57354-6013-4114-8ebe-8383e1424a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:59.295459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba57354-6013-4114-8ebe-8383e1424a8c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:59.314821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:59.372465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:59.403103 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d6be-7b27-442b-8cac-41e898ba6ce7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:59.421063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 331/658] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:59.422323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba57354-6013-4114-8ebe-8383e1424a8c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:59.438827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df020f81-2fd6-48d6-87a5-35cbc56b96f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:59.439493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df020f81-2fd6-48d6-87a5-35cbc56b96f3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.445372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df020f81-2fd6-48d6-87a5-35cbc56b96f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.445372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df020f81-2fd6-48d6-87a5-35cbc56b96f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.513314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df020f81-2fd6-48d6-87a5-35cbc56b96f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:59.514699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df020f81-2fd6-48d6-87a5-35cbc56b96f3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:59.535182 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba57354-6013-4114-8ebe-8383e1424a8c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:59.548257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:59.572141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f501427-7523-4f9e-bab4-852179bbaa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:59.573158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f501427-7523-4f9e-bab4-852179bbaa43 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.573678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f501427-7523-4f9e-bab4-852179bbaa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.574156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f501427-7523-4f9e-bab4-852179bbaa43 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.575189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f501427-7523-4f9e-bab4-852179bbaa43 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:55:59.575726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f501427-7523-4f9e-bab4-852179bbaa43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:59.577391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f501427-7523-4f9e-bab4-852179bbaa43 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:59.601730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 332/659] 10.222.0.49 () {56 vars in 1137 bytes} [Tue Jun 28 11:55:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:55:59.602987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f501427-7523-4f9e-bab4-852179bbaa43 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:59.625512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 328/660] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:59.625512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df020f81-2fd6-48d6-87a5-35cbc56b96f3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:59.634610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:59.715451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f501427-7523-4f9e-bab4-852179bbaa43 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:59.732377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df020f81-2fd6-48d6-87a5-35cbc56b96f3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:59.753877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd44e67-4941-432e-82b7-19a276452c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:59.755098 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd44e67-4941-432e-82b7-19a276452c70 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.755545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd44e67-4941-432e-82b7-19a276452c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.755972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd44e67-4941-432e-82b7-19a276452c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.760657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:59.769277 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22bc22-b093-43b6-8d2e-231a815334a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:59.769428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd44e67-4941-432e-82b7-19a276452c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:59.769527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22bc22-b093-43b6-8d2e-231a815334a9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.769527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22bc22-b093-43b6-8d2e-231a815334a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.769527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22bc22-b093-43b6-8d2e-231a815334a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.770385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd44e67-4941-432e-82b7-19a276452c70 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5cd44e67-4941-432e-82b7-19a276452c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:59.791276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:59.792434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:59.794022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:59.794022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:59.794022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:59.794022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:59.794022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 333/661] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:59.794022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd44e67-4941-432e-82b7-19a276452c70 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:59.845698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22bc22-b093-43b6-8d2e-231a815334a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:59.847698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22bc22-b093-43b6-8d2e-231a815334a9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:59.875307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:55:59.902273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd44e67-4941-432e-82b7-19a276452c70 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:55:59.938741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06cff-2417-4c06-9902-cc6f49535e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:55:59.939532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06cff-2417-4c06-9902-cc6f49535e00 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.939819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06cff-2417-4c06-9902-cc6f49535e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.940142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06cff-2417-4c06-9902-cc6f49535e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.950860 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec06cff-2417-4c06-9902-cc6f49535e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:55:59.952363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec06cff-2417-4c06-9902-cc6f49535e00 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:55:59.952733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 329/662] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:55:59.959258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591b585-387f-4c2a-851e-c11583afc808 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:55:59.959554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591b585-387f-4c2a-851e-c11583afc808 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:55:59.959836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591b585-387f-4c2a-851e-c11583afc808 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:55:59.961293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 330/663] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:55:59.961854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591b585-387f-4c2a-851e-c11583afc808 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5ec06cff-2417-4c06-9902-cc6f49535e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:55:59.977276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:55:59.978327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:55:59.979203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:55:59.979203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:55:59.979203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:55:59.979203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:55:59.979203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 334/664] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:55:59.980357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06cff-2417-4c06-9902-cc6f49535e00 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:55:59.997153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:00.078796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591b585-387f-4c2a-851e-c11583afc808 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.082595 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06cff-2417-4c06-9902-cc6f49535e00 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.108768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:00.117447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29362e31-e21c-4f81-a341-2ce2d2f40658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.117793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709eaed-5428-4cd3-8414-0385c0bb371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.118362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29362e31-e21c-4f81-a341-2ce2d2f40658 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.118468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709eaed-5428-4cd3-8414-0385c0bb371b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.118551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29362e31-e21c-4f81-a341-2ce2d2f40658 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.118724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709eaed-5428-4cd3-8414-0385c0bb371b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.118817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29362e31-e21c-4f81-a341-2ce2d2f40658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.119025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709eaed-5428-4cd3-8414-0385c0bb371b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.119891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709eaed-5428-4cd3-8414-0385c0bb371b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:00.120224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709eaed-5428-4cd3-8414-0385c0bb371b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:00.121611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709eaed-5428-4cd3-8414-0385c0bb371b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:00.128920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29362e31-e21c-4f81-a341-2ce2d2f40658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:00.130436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29362e31-e21c-4f81-a341-2ce2d2f40658 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:00.133596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 331/665] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:00.135064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8c63-ea26-470d-91e4-d403917aed53 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.135520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8c63-ea26-470d-91e4-d403917aed53 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.136018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c8c63-ea26-470d-91e4-d403917aed53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-29362e31-e21c-4f81-a341-2ce2d2f40658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:00.150207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:00.151254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:00.152169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:00.152169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:00.152169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:00.152169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:00.156079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 335/666] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:00.156779 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29362e31-e21c-4f81-a341-2ce2d2f40658 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.157355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-885c8c63-ea26-470d-91e4-d403917aed53 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:00.160052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-885c8c63-ea26-470d-91e4-d403917aed53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:00.233069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 332/667] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:56:00.233909 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8c63-ea26-470d-91e4-d403917aed53 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.260677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:00.265872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29362e31-e21c-4f81-a341-2ce2d2f40658 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.299759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1ada5-3871-42d5-b34e-1e7bdf098ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.300588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1ada5-3871-42d5-b34e-1e7bdf098ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.300871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1ada5-3871-42d5-b34e-1e7bdf098ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.301149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1ada5-3871-42d5-b34e-1e7bdf098ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.301872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1ada5-3871-42d5-b34e-1e7bdf098ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:00.302186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1ada5-3871-42d5-b34e-1e7bdf098ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:00.303560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1ada5-3871-42d5-b34e-1e7bdf098ee3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:00.314380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 336/668] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:00.315168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1ada5-3871-42d5-b34e-1e7bdf098ee3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.340140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c8c63-ea26-470d-91e4-d403917aed53 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.356917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:00.373228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed79ce1-acf5-42fa-ab88-d64b7f516578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.374025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed79ce1-acf5-42fa-ab88-d64b7f516578 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.374309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed79ce1-acf5-42fa-ab88-d64b7f516578 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.374585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed79ce1-acf5-42fa-ab88-d64b7f516578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.381857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed79ce1-acf5-42fa-ab88-d64b7f516578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:00.383315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed79ce1-acf5-42fa-ab88-d64b7f516578 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-aed79ce1-acf5-42fa-ab88-d64b7f516578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:00.397392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:00.398250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:00.399116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:00.399116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:00.399116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:00.399116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:00.399116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:00.399116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:00.399116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:00.399116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:00.399116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 333/669] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:00.399737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927ea60-e0d4-41c0-b676-1a3a22ecb4bb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.400065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927ea60-e0d4-41c0-b676-1a3a22ecb4bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.400338 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927ea60-e0d4-41c0-b676-1a3a22ecb4bb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.401562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 334/670] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:00.402244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927ea60-e0d4-41c0-b676-1a3a22ecb4bb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.422517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1ada5-3871-42d5-b34e-1e7bdf098ee3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.458097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82206f5-5fa5-499d-9e8f-3bfd68b960a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.458781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82206f5-5fa5-499d-9e8f-3bfd68b960a2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.459062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82206f5-5fa5-499d-9e8f-3bfd68b960a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.459336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82206f5-5fa5-499d-9e8f-3bfd68b960a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.460092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82206f5-5fa5-499d-9e8f-3bfd68b960a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:00.460398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82206f5-5fa5-499d-9e8f-3bfd68b960a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:00.461785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82206f5-5fa5-499d-9e8f-3bfd68b960a2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:00.473507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 337/671] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:00.474302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82206f5-5fa5-499d-9e8f-3bfd68b960a2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.486812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:00.508853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927ea60-e0d4-41c0-b676-1a3a22ecb4bb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.543599 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a77e8-ad98-4dac-bf74-5271b82f9039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.544432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a77e8-ad98-4dac-bf74-5271b82f9039 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.544718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a77e8-ad98-4dac-bf74-5271b82f9039 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.544994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a77e8-ad98-4dac-bf74-5271b82f9039 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.554895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a77e8-ad98-4dac-bf74-5271b82f9039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-056a77e8-ad98-4dac-bf74-5271b82f9039 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:00.562559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:00.563665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 335/672] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:00.570141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a77e8-ad98-4dac-bf74-5271b82f9039 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.576309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:00.580351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82206f5-5fa5-499d-9e8f-3bfd68b960a2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.616309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b4e4c-08ed-4832-a554-359dfbe9b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.617137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4e4c-08ed-4832-a554-359dfbe9b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.617424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4e4c-08ed-4832-a554-359dfbe9b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.617696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4e4c-08ed-4832-a554-359dfbe9b1b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.624421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b4e4c-08ed-4832-a554-359dfbe9b1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:00.625867 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b4e4c-08ed-4832-a554-359dfbe9b1b7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ac8b4e4c-08ed-4832-a554-359dfbe9b1b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:00.639927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:00.641387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:00.642254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:00.642254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:00.642254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:00.642254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:00.642254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:00.642254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:00.642254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:00.642254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:00.642254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 338/673] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:00.642797 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4648-57f3-48c9-802e-424f7623d6bd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.642995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4648-57f3-48c9-802e-424f7623d6bd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.643276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4648-57f3-48c9-802e-424f7623d6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.661047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1cde4648-57f3-48c9-802e-424f7623d6bd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:00.662234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1cde4648-57f3-48c9-802e-424f7623d6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:00.668182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a77e8-ad98-4dac-bf74-5271b82f9039 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.703637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588eb0d-08e5-4ed2-a41f-60162a07de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.704406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588eb0d-08e5-4ed2-a41f-60162a07de95 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.704690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588eb0d-08e5-4ed2-a41f-60162a07de95 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.704970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588eb0d-08e5-4ed2-a41f-60162a07de95 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.705758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588eb0d-08e5-4ed2-a41f-60162a07de95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:00.706773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588eb0d-08e5-4ed2-a41f-60162a07de95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:00.708225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588eb0d-08e5-4ed2-a41f-60162a07de95 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:00.715027 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:00.720134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 336/674] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:00.720911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588eb0d-08e5-4ed2-a41f-60162a07de95 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.734003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 339/675] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:56:00.734933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4648-57f3-48c9-802e-424f7623d6bd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.824331 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:00.825575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588eb0d-08e5-4ed2-a41f-60162a07de95 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.836869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4648-57f3-48c9-802e-424f7623d6bd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.859957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e96d78-929a-4403-b5af-cb548f0b6352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.860743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e96d78-929a-4403-b5af-cb548f0b6352 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.861024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e96d78-929a-4403-b5af-cb548f0b6352 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.861292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e96d78-929a-4403-b5af-cb548f0b6352 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.867829 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e96d78-929a-4403-b5af-cb548f0b6352 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:00.869248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e96d78-929a-4403-b5af-cb548f0b6352 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:00.872870 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3b37-f5d7-48eb-9ea8-9d2f0036a00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:00.873538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3b37-f5d7-48eb-9ea8-9d2f0036a00a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:00.873825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3b37-f5d7-48eb-9ea8-9d2f0036a00a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:00.874104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3b37-f5d7-48eb-9ea8-9d2f0036a00a None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:00.874854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f3b37-f5d7-48eb-9ea8-9d2f0036a00a None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:00.875160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f3b37-f5d7-48eb-9ea8-9d2f0036a00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:00.876557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f3b37-f5d7-48eb-9ea8-9d2f0036a00a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d1e96d78-929a-4403-b5af-cb548f0b6352 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:00.882594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:00.883602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:00.884683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:00.884683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:00.884683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:00.884683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:00.884683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:00.884683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:00.884683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:00.884683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:00.884683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 337/676] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:00.885437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e96d78-929a-4403-b5af-cb548f0b6352 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.886221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 340/677] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:00.887447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3b37-f5d7-48eb-9ea8-9d2f0036a00a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:00.943182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:00.985694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e96d78-929a-4403-b5af-cb548f0b6352 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:00.991525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3b37-f5d7-48eb-9ea8-9d2f0036a00a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.019918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cbe67-ed66-4d31-991a-d89bde129fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.020573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cbe67-ed66-4d31-991a-d89bde129fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.020851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cbe67-ed66-4d31-991a-d89bde129fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.021126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cbe67-ed66-4d31-991a-d89bde129fc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.021907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cbe67-ed66-4d31-991a-d89bde129fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:01.022214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cbe67-ed66-4d31-991a-d89bde129fc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.023638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cbe67-ed66-4d31-991a-d89bde129fc5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:01.025743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4cc7-b43c-4b95-84f2-39be06b2affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.026396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4cc7-b43c-4b95-84f2-39be06b2affd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.026681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4cc7-b43c-4b95-84f2-39be06b2affd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.026960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4cc7-b43c-4b95-84f2-39be06b2affd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.027790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf4cc7-b43c-4b95-84f2-39be06b2affd None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=6784d862961b44f48b385bec777ac439) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:01.028134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf4cc7-b43c-4b95-84f2-39be06b2affd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.029554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf4cc7-b43c-4b95-84f2-39be06b2affd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:01.035411 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 341/678] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/role_assignments?user.id=6784d862961b44f48b385bec777ac439&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:01.036215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4cc7-b43c-4b95-84f2-39be06b2affd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.041415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 338/679] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:01.041415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cbe67-ed66-4d31-991a-d89bde129fc5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.060682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:01.162820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cbe67-ed66-4d31-991a-d89bde129fc5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.163113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4cc7-b43c-4b95-84f2-39be06b2affd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.181687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:01.204822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93fc81-0107-4e26-a245-0586da1e1a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.205247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9714-8714-4b72-9d11-27f86c686002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.205498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93fc81-0107-4e26-a245-0586da1e1a52 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.205810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93fc81-0107-4e26-a245-0586da1e1a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.206810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93fc81-0107-4e26-a245-0586da1e1a52 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.207435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9714-8714-4b72-9d11-27f86c686002 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.207658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93fc81-0107-4e26-a245-0586da1e1a52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:01.207763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9714-8714-4b72-9d11-27f86c686002 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.208032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93fc81-0107-4e26-a245-0586da1e1a52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.208129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9714-8714-4b72-9d11-27f86c686002 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.209468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93fc81-0107-4e26-a245-0586da1e1a52 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:01.219123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb9714-8714-4b72-9d11-27f86c686002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:01.222792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 339/680] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:01.223712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93fc81-0107-4e26-a245-0586da1e1a52 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-19cb9714-8714-4b72-9d11-27f86c686002 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:01.227795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:01.228920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:01.229932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 342/681] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:01.230813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9714-8714-4b72-9d11-27f86c686002 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.310481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:01.335168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9714-8714-4b72-9d11-27f86c686002 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.340075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93fc81-0107-4e26-a245-0586da1e1a52 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.371569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd598b4-bf60-4135-b182-31e5f4729f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.372266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd598b4-bf60-4135-b182-31e5f4729f80 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.372551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd598b4-bf60-4135-b182-31e5f4729f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.372826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd598b4-bf60-4135-b182-31e5f4729f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.373664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd598b4-bf60-4135-b182-31e5f4729f80 None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=3ff61c1fbdf34fa38588e4cd2cdc5398) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:01.373978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd598b4-bf60-4135-b182-31e5f4729f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.375456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd598b4-bf60-4135-b182-31e5f4729f80 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:01.379230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3519b1b-632b-4b61-bbfd-78c368521ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.380077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3519b1b-632b-4b61-bbfd-78c368521ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.380367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3519b1b-632b-4b61-bbfd-78c368521ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.380648 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3519b1b-632b-4b61-bbfd-78c368521ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.388165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 343/682] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/role_assignments?user.id=3ff61c1fbdf34fa38588e4cd2cdc5398&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:01.388165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd598b4-bf60-4135-b182-31e5f4729f80 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.399897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3519b1b-632b-4b61-bbfd-78c368521ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.401590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3519b1b-632b-4b61-bbfd-78c368521ff1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c3519b1b-632b-4b61-bbfd-78c368521ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:01.422411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:01.423609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:01.424851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:01.424851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:01.424851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:01.424851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:01.424851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 340/683] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:01.429459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3519b1b-632b-4b61-bbfd-78c368521ff1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.465216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:01.521221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd598b4-bf60-4135-b182-31e5f4729f80 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.554977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3519b1b-632b-4b61-bbfd-78c368521ff1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.573630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e13f7-b8a8-4017-b885-634bf3d5cd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.574456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e13f7-b8a8-4017-b885-634bf3d5cd18 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.575291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e13f7-b8a8-4017-b885-634bf3d5cd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.575671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e13f7-b8a8-4017-b885-634bf3d5cd18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.576910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e13f7-b8a8-4017-b885-634bf3d5cd18 None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=62bbcb039ed44749ab80bfc97dabd7b4) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:01.577597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e13f7-b8a8-4017-b885-634bf3d5cd18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.579557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e13f7-b8a8-4017-b885-634bf3d5cd18 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:01.587391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 344/684] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/role_assignments?user.id=62bbcb039ed44749ab80bfc97dabd7b4&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:01.588361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e13f7-b8a8-4017-b885-634bf3d5cd18 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.591398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:01.601137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c886d-7501-4423-816f-d198a6c388c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.602138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c886d-7501-4423-816f-d198a6c388c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.604437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c886d-7501-4423-816f-d198a6c388c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.604437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c886d-7501-4423-816f-d198a6c388c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.604437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c886d-7501-4423-816f-d198a6c388c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:01.604437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c886d-7501-4423-816f-d198a6c388c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.605424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c886d-7501-4423-816f-d198a6c388c1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:01.616374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 341/685] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:01.626331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c886d-7501-4423-816f-d198a6c388c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.723314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e13f7-b8a8-4017-b885-634bf3d5cd18 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.759459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:01.770534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c886d-7501-4423-816f-d198a6c388c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.772897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfef268-58b9-423b-9fbd-0031675a7467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.773702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef268-58b9-423b-9fbd-0031675a7467 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.774093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef268-58b9-423b-9fbd-0031675a7467 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.774480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef268-58b9-423b-9fbd-0031675a7467 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.775372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfef268-58b9-423b-9fbd-0031675a7467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:01.775792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfef268-58b9-423b-9fbd-0031675a7467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.777314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfef268-58b9-423b-9fbd-0031675a7467 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:01.791582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 345/686] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:01.796912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfef268-58b9-423b-9fbd-0031675a7467 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.818018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe2741-2b08-4ac8-852f-6b52663c963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.819590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe2741-2b08-4ac8-852f-6b52663c963a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.820132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe2741-2b08-4ac8-852f-6b52663c963a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.820607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe2741-2b08-4ac8-852f-6b52663c963a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.835448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe2741-2b08-4ac8-852f-6b52663c963a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.838074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe2741-2b08-4ac8-852f-6b52663c963a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e4fe2741-2b08-4ac8-852f-6b52663c963a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:01.863325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:01.864378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:01.865246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:01.865246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:01.865246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:01.865246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:01.871078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 342/687] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:01.873953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe2741-2b08-4ac8-852f-6b52663c963a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:01.880624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:01.930275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfef268-58b9-423b-9fbd-0031675a7467 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:01.983995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e1d54-684d-4c78-8cf0-86aca92cab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:01.984598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e1d54-684d-4c78-8cf0-86aca92cab94 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:01.984881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e1d54-684d-4c78-8cf0-86aca92cab94 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:01.985155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e1d54-684d-4c78-8cf0-86aca92cab94 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:01.995893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e1d54-684d-4c78-8cf0-86aca92cab94 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:01.995893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e1d54-684d-4c78-8cf0-86aca92cab94 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f21e1d54-684d-4c78-8cf0-86aca92cab94 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:02.011646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:02.012822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:02.013975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 346/688] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:02.020864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e1d54-684d-4c78-8cf0-86aca92cab94 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:02.060538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe2741-2b08-4ac8-852f-6b52663c963a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:02.111448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafbd9c-af26-464e-b9e8-48d10278f3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:02.112809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafbd9c-af26-464e-b9e8-48d10278f3be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:02.113513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafbd9c-af26-464e-b9e8-48d10278f3be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:02.113513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafbd9c-af26-464e-b9e8-48d10278f3be None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:02.114068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafbd9c-af26-464e-b9e8-48d10278f3be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:02.114369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafbd9c-af26-464e-b9e8-48d10278f3be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:02.115749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafbd9c-af26-464e-b9e8-48d10278f3be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:02.139236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 343/689] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:02.146122 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafbd9c-af26-464e-b9e8-48d10278f3be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:02.152432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:02.214231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e1d54-684d-4c78-8cf0-86aca92cab94 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:02.255509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:02.276593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4de71f-b098-49f2-b88e-9580e907993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:02.277353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4de71f-b098-49f2-b88e-9580e907993b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:02.277642 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4de71f-b098-49f2-b88e-9580e907993b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:02.277921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4de71f-b098-49f2-b88e-9580e907993b None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:02.278778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4de71f-b098-49f2-b88e-9580e907993b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:02.279119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4de71f-b098-49f2-b88e-9580e907993b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:02.285296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4de71f-b098-49f2-b88e-9580e907993b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:02.305228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafbd9c-af26-464e-b9e8-48d10278f3be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:02.324516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 347/690] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Jun 28 11:56:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:02.328783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4de71f-b098-49f2-b88e-9580e907993b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:02.372013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a715c4-5e03-4462-8834-37bc2244d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:02.373369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a715c4-5e03-4462-8834-37bc2244d8ac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:02.373860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a715c4-5e03-4462-8834-37bc2244d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:02.374336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a715c4-5e03-4462-8834-37bc2244d8ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:02.383796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a715c4-5e03-4462-8834-37bc2244d8ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:02.385810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a715c4-5e03-4462-8834-37bc2244d8ac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d0a715c4-5e03-4462-8834-37bc2244d8ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:02.412210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:02.413208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:02.414115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 344/691] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Jun 28 11:56:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:02.420802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a715c4-5e03-4462-8834-37bc2244d8ac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:02.467611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4de71f-b098-49f2-b88e-9580e907993b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:02.512528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e84939-d820-4f6a-9cf5-3ed0ec7fdbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:02.513576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e84939-d820-4f6a-9cf5-3ed0ec7fdbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:02.514057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e84939-d820-4f6a-9cf5-3ed0ec7fdbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:02.514545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e84939-d820-4f6a-9cf5-3ed0ec7fdbe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:02.573546 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:02.586396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:02.594726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e84939-d820-4f6a-9cf5-3ed0ec7fdbe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:02.596241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e84939-d820-4f6a-9cf5-3ed0ec7fdbe8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:02.662783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a715c4-5e03-4462-8834-37bc2244d8ac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:02.698201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60b96e-848d-4cda-8089-2c728428541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:02.699216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60b96e-848d-4cda-8089-2c728428541b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:02.699703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60b96e-848d-4cda-8089-2c728428541b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:02.700201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60b96e-848d-4cda-8089-2c728428541b None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:02.701265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60b96e-848d-4cda-8089-2c728428541b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:02.701782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60b96e-848d-4cda-8089-2c728428541b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:02.703406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60b96e-848d-4cda-8089-2c728428541b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:02.727284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 345/692] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Jun 28 11:56:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:02.728799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60b96e-848d-4cda-8089-2c728428541b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:02.751264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 348/693] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 11:56:02.760841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e84939-d820-4f6a-9cf5-3ed0ec7fdbe8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:02.876449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60b96e-848d-4cda-8089-2c728428541b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:02.924347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409db12a-7fda-4afa-8b6f-91f5b8598ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:02.925532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409db12a-7fda-4afa-8b6f-91f5b8598ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:02.925824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409db12a-7fda-4afa-8b6f-91f5b8598ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:02.926086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409db12a-7fda-4afa-8b6f-91f5b8598ec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:02.927425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:02.948767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:02.975890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e84939-d820-4f6a-9cf5-3ed0ec7fdbe8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:03.019494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409db12a-7fda-4afa-8b6f-91f5b8598ec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:03.020975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409db12a-7fda-4afa-8b6f-91f5b8598ec5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:03.048407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9b9b2-7b2d-4d09-a9fb-0f59d0bee9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:03.049287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9b9b2-7b2d-4d09-a9fb-0f59d0bee9ef None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:03.050158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9b9b2-7b2d-4d09-a9fb-0f59d0bee9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:03.050638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9b9b2-7b2d-4d09-a9fb-0f59d0bee9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:03.076203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9b9b2-7b2d-4d09-a9fb-0f59d0bee9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:03.077910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9b9b2-7b2d-4d09-a9fb-0f59d0bee9ef None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-19d9b9b2-7b2d-4d09-a9fb-0f59d0bee9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:03.125453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:03.126390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:03.127295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:03.127295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:03.127295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:03.127295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:03.127295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 349/694] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:03.132730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9b9b2-7b2d-4d09-a9fb-0f59d0bee9ef None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:03.134091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 346/695] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 11:56:03.135265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409db12a-7fda-4afa-8b6f-91f5b8598ec5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:03.175308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:03.262597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9b9b2-7b2d-4d09-a9fb-0f59d0bee9ef None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:03.313161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409db12a-7fda-4afa-8b6f-91f5b8598ec5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:03.337353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:03.349816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c711a9-61ef-4f30-83c9-46691c64fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:03.350622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c711a9-61ef-4f30-83c9-46691c64fb0d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:03.350904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c711a9-61ef-4f30-83c9-46691c64fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:03.351183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c711a9-61ef-4f30-83c9-46691c64fb0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:03.353423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169bae6-592d-4c39-818e-0a4e52fc6fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:03.354093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169bae6-592d-4c39-818e-0a4e52fc6fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:03.354409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169bae6-592d-4c39-818e-0a4e52fc6fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:03.354689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169bae6-592d-4c39-818e-0a4e52fc6fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:03.355420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169bae6-592d-4c39-818e-0a4e52fc6fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:03.355733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169bae6-592d-4c39-818e-0a4e52fc6fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:03.357139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169bae6-592d-4c39-818e-0a4e52fc6fb0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:03.362988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c711a9-61ef-4f30-83c9-46691c64fb0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:03.364512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c711a9-61ef-4f30-83c9-46691c64fb0d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b0c711a9-61ef-4f30-83c9-46691c64fb0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:03.383445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:03.384415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:03.385331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:03.385331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:03.385331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:03.385331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:03.388264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 350/697] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:03.388382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 347/697] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:03.392811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169bae6-592d-4c39-818e-0a4e52fc6fb0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:03.393097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c711a9-61ef-4f30-83c9-46691c64fb0d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:03.476860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:03.504453 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c711a9-61ef-4f30-83c9-46691c64fb0d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:03.542112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26277ca1-b609-4298-9fc0-356d3f805c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:03.542919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26277ca1-b609-4298-9fc0-356d3f805c7a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:03.543200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26277ca1-b609-4298-9fc0-356d3f805c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:03.543475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26277ca1-b609-4298-9fc0-356d3f805c7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:03.551637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26277ca1-b609-4298-9fc0-356d3f805c7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:03.553387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26277ca1-b609-4298-9fc0-356d3f805c7a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-26277ca1-b609-4298-9fc0-356d3f805c7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:03.567901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:03.568872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:03.569812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:03.569812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:03.569812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:03.569812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:03.569812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:03.569812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:03.569812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:03.569812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:03.569812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 348/698] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:03.574541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26277ca1-b609-4298-9fc0-356d3f805c7a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:03.633955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169bae6-592d-4c39-818e-0a4e52fc6fb0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:03.679455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812c259-9afe-4dec-aab3-c0fbc75473a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:03.680394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812c259-9afe-4dec-aab3-c0fbc75473a7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:03.680680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812c259-9afe-4dec-aab3-c0fbc75473a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:03.680956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812c259-9afe-4dec-aab3-c0fbc75473a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:03.682570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812c259-9afe-4dec-aab3-c0fbc75473a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:03.682884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812c259-9afe-4dec-aab3-c0fbc75473a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:03.684424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812c259-9afe-4dec-aab3-c0fbc75473a7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:03.703979 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 351/699] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:03.705696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31955b-d3fa-4891-a401-572eeef1e693 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:03.707748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31955b-d3fa-4891-a401-572eeef1e693 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:03.708422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31955b-d3fa-4891-a401-572eeef1e693 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:03.711194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 352/700] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:03.712981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31955b-d3fa-4891-a401-572eeef1e693 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:03.725892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26277ca1-b609-4298-9fc0-356d3f805c7a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:03.762265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5f24e-17c9-4908-86c4-b90de8e0c765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:03.762845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5f24e-17c9-4908-86c4-b90de8e0c765 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:03.763132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5f24e-17c9-4908-86c4-b90de8e0c765 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:03.763411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5f24e-17c9-4908-86c4-b90de8e0c765 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:03.764319 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5f24e-17c9-4908-86c4-b90de8e0c765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:03.764598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5f24e-17c9-4908-86c4-b90de8e0c765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:03.766174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5f24e-17c9-4908-86c4-b90de8e0c765 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:03.767932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:03.775219 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:03.780155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 349/701] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:03.781571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370602e0-e63d-4231-b6b6-11b2cb5f36a5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:03.781859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370602e0-e63d-4231-b6b6-11b2cb5f36a5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:03.782132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370602e0-e63d-4231-b6b6-11b2cb5f36a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:03.799800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-370602e0-e63d-4231-b6b6-11b2cb5f36a5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:03.801364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-370602e0-e63d-4231-b6b6-11b2cb5f36a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:03.828373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31955b-d3fa-4891-a401-572eeef1e693 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:03.870073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04202b-1493-46ce-a779-25e197709dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:03.871248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04202b-1493-46ce-a779-25e197709dce None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:03.871836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04202b-1493-46ce-a779-25e197709dce None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:03.872358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04202b-1493-46ce-a779-25e197709dce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:03.880670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04202b-1493-46ce-a779-25e197709dce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:03.882379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04202b-1493-46ce-a779-25e197709dce None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:03.884054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 350/702] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:56:03.884955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370602e0-e63d-4231-b6b6-11b2cb5f36a5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-fc04202b-1493-46ce-a779-25e197709dce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:03.898055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:03.898948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:03.899829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:03.899829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:03.899829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:03.899829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:03.899829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:03.899829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:03.899829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:03.899829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:03.903165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 353/703] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:03.912823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04202b-1493-46ce-a779-25e197709dce None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:04.000199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370602e0-e63d-4231-b6b6-11b2cb5f36a5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:04.030544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:04.035182 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04202b-1493-46ce-a779-25e197709dce None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:04.041853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd10e0-1e73-490d-8f84-822f69c4bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:04.042956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd10e0-1e73-490d-8f84-822f69c4bbea None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.043235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd10e0-1e73-490d-8f84-822f69c4bbea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.043512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd10e0-1e73-490d-8f84-822f69c4bbea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.044740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd10e0-1e73-490d-8f84-822f69c4bbea None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=66e90e70937d49c8a35928fcfc90972d) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:04.045057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd10e0-1e73-490d-8f84-822f69c4bbea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:04.046806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd10e0-1e73-490d-8f84-822f69c4bbea None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:04.048261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:04.053699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 351/704] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:03 2022] GET /identity/v3/role_assignments?user.id=66e90e70937d49c8a35928fcfc90972d&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:04.054496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd10e0-1e73-490d-8f84-822f69c4bbea None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:04.090872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43c112-634e-4f0f-afd3-bba51888047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:04.091658 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43c112-634e-4f0f-afd3-bba51888047d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.091978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43c112-634e-4f0f-afd3-bba51888047d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.092257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43c112-634e-4f0f-afd3-bba51888047d None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.093077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43c112-634e-4f0f-afd3-bba51888047d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:04.093387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43c112-634e-4f0f-afd3-bba51888047d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:04.094866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43c112-634e-4f0f-afd3-bba51888047d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:04.109073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 354/705] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:04.110451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb35336-8ada-4da1-9545-6f6f8af6a0a7 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.111204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb35336-8ada-4da1-9545-6f6f8af6a0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.111480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb35336-8ada-4da1-9545-6f6f8af6a0a7 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.113448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 355/706] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:04.114509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f7bf1-f0e2-4e12-b475-7e97b0c6d133 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.114784 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f7bf1-f0e2-4e12-b475-7e97b0c6d133 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.115057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f7bf1-f0e2-4e12-b475-7e97b0c6d133 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.116683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 356/707] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:04.117493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f7bf1-f0e2-4e12-b475-7e97b0c6d133 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:04.174044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd10e0-1e73-490d-8f84-822f69c4bbea None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:04.214129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfacab-5265-49c8-ac4a-9eeaf16a5146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:04.214956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfacab-5265-49c8-ac4a-9eeaf16a5146 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.215243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfacab-5265-49c8-ac4a-9eeaf16a5146 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.215509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfacab-5265-49c8-ac4a-9eeaf16a5146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.230581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfacab-5265-49c8-ac4a-9eeaf16a5146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:04.232084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfacab-5265-49c8-ac4a-9eeaf16a5146 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:04.242829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f7bf1-f0e2-4e12-b475-7e97b0c6d133 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a9bfacab-5265-49c8-ac4a-9eeaf16a5146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:04.252356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:04.253322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:04.254226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:04.254226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:04.254226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:04.254226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:04.254226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 352/708] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:04.254512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be84ce-2deb-4d70-a96e-5e7b5463e02a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.255031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be84ce-2deb-4d70-a96e-5e7b5463e02a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.255031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be84ce-2deb-4d70-a96e-5e7b5463e02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.273405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-02be84ce-2deb-4d70-a96e-5e7b5463e02a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:04.274606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-02be84ce-2deb-4d70-a96e-5e7b5463e02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:04.288311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b07467-414d-47f5-99c8-da1ff15e3dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:04.289569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b07467-414d-47f5-99c8-da1ff15e3dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.289569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b07467-414d-47f5-99c8-da1ff15e3dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.289569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b07467-414d-47f5-99c8-da1ff15e3dc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.290507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b07467-414d-47f5-99c8-da1ff15e3dc4 None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=fbfe6b7a82f746169a39976be263aa29) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:04.290678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b07467-414d-47f5-99c8-da1ff15e3dc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:04.292114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b07467-414d-47f5-99c8-da1ff15e3dc4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:04.298615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 357/709] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:04 2022] GET /identity/v3/role_assignments?user.id=fbfe6b7a82f746169a39976be263aa29&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:04.300671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8a46-ec2d-4097-9c0d-57bff7638872 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.300956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8a46-ec2d-4097-9c0d-57bff7638872 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.301227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8a46-ec2d-4097-9c0d-57bff7638872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.318815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-226a8a46-ec2d-4097-9c0d-57bff7638872 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:04.320147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-226a8a46-ec2d-4097-9c0d-57bff7638872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:04.324435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:04.357117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:04.379991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 353/710] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:56:04.381070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be84ce-2deb-4d70-a96e-5e7b5463e02a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:04.414835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 358/711] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:56:04.415824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8a46-ec2d-4097-9c0d-57bff7638872 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:04.529141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be84ce-2deb-4d70-a96e-5e7b5463e02a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:04.563038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8a46-ec2d-4097-9c0d-57bff7638872 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:04.570514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5351a73-4121-46ff-87b9-0fce7eb9ecfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:04.571345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351a73-4121-46ff-87b9-0fce7eb9ecfc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.571669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351a73-4121-46ff-87b9-0fce7eb9ecfc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.572037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5351a73-4121-46ff-87b9-0fce7eb9ecfc None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.572896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5351a73-4121-46ff-87b9-0fce7eb9ecfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:04.573270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5351a73-4121-46ff-87b9-0fce7eb9ecfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:04.575363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5351a73-4121-46ff-87b9-0fce7eb9ecfc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:04.591702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 354/712] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:04.593127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5351a73-4121-46ff-87b9-0fce7eb9ecfc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:04.604287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6eceb-24e0-403c-baf1-ed849dd8f9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:04.605481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6eceb-24e0-403c-baf1-ed849dd8f9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.605994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6eceb-24e0-403c-baf1-ed849dd8f9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.606525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6eceb-24e0-403c-baf1-ed849dd8f9e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.607381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6eceb-24e0-403c-baf1-ed849dd8f9e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:04.609041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6eceb-24e0-403c-baf1-ed849dd8f9e5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-afe6eceb-24e0-403c-baf1-ed849dd8f9e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:04.624683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:04.625777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 11:56:04.626607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:04.630132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:04.630606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 359/713] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:04 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:04.631717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6eceb-24e0-403c-baf1-ed849dd8f9e5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:04.677277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:04.714959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5351a73-4121-46ff-87b9-0fce7eb9ecfc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:04.757044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6eceb-24e0-403c-baf1-ed849dd8f9e5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:04.770145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b9cbe-e223-4df5-bb3f-f85ea2334adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:04.771520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b9cbe-e223-4df5-bb3f-f85ea2334adc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.772292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b9cbe-e223-4df5-bb3f-f85ea2334adc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.772817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b9cbe-e223-4df5-bb3f-f85ea2334adc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.774319 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b9cbe-e223-4df5-bb3f-f85ea2334adc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:04.776244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b9cbe-e223-4df5-bb3f-f85ea2334adc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:04.794314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d0bc-c181-4bc6-bb10-446499c3dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:04.795127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d0bc-c181-4bc6-bb10-446499c3dd0b None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.795508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d0bc-c181-4bc6-bb10-446499c3dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.795893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23d0bc-c181-4bc6-bb10-446499c3dd0b None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-857b9cbe-e223-4df5-bb3f-f85ea2334adc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:04.796210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:04.797286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 11:56:04.798301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:04.799532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23d0bc-c181-4bc6-bb10-446499c3dd0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:04.801113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 355/714] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Jun 28 11:56:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:04.802047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b9cbe-e223-4df5-bb3f-f85ea2334adc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:04.805826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23d0bc-c181-4bc6-bb10-446499c3dd0b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:04.897937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 360/715] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:56:04 2022] POST /identity/v3/users => generated 254 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:04.899559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d0bc-c181-4bc6-bb10-446499c3dd0b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:04.909680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:04.918351 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b9cbe-e223-4df5-bb3f-f85ea2334adc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:04.958413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf0a1-9957-4485-a905-dff8f3d53bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:04.959387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf0a1-9957-4485-a905-dff8f3d53bdc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:04.959775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf0a1-9957-4485-a905-dff8f3d53bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:04.960192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bf0a1-9957-4485-a905-dff8f3d53bdc None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:04.961013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bf0a1-9957-4485-a905-dff8f3d53bdc None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:04.961426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bf0a1-9957-4485-a905-dff8f3d53bdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:04.962956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bf0a1-9957-4485-a905-dff8f3d53bdc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:04.968594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 356/716] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:04.975196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf0a1-9957-4485-a905-dff8f3d53bdc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:05.026366 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:05.047119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23d0bc-c181-4bc6-bb10-446499c3dd0b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:05.092679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22130379-2ff6-499e-bec7-df25be3199f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:05.093893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22130379-2ff6-499e-bec7-df25be3199f1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:05.094320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22130379-2ff6-499e-bec7-df25be3199f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:05.094735 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22130379-2ff6-499e-bec7-df25be3199f1 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:05.096265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22130379-2ff6-499e-bec7-df25be3199f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:05.097397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22130379-2ff6-499e-bec7-df25be3199f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:05.099662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22130379-2ff6-499e-bec7-df25be3199f1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:05.106158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 361/717] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Jun 28 11:56:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:05.115801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22130379-2ff6-499e-bec7-df25be3199f1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:05.156013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bf0a1-9957-4485-a905-dff8f3d53bdc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:05.224490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470aa6d-2833-4d3a-a47b-41e2923f0b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:05.226021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470aa6d-2833-4d3a-a47b-41e2923f0b21 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:05.227020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470aa6d-2833-4d3a-a47b-41e2923f0b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:05.227777 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470aa6d-2833-4d3a-a47b-41e2923f0b21 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:05.229483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470aa6d-2833-4d3a-a47b-41e2923f0b21 None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:05.230315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470aa6d-2833-4d3a-a47b-41e2923f0b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:05.233102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470aa6d-2833-4d3a-a47b-41e2923f0b21 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:05.244353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 357/718] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:05.258750 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22130379-2ff6-499e-bec7-df25be3199f1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:05.296404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfdad9-9a1d-49fe-952e-355351d63ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:05.296978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfdad9-9a1d-49fe-952e-355351d63ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:05.297259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfdad9-9a1d-49fe-952e-355351d63ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:05.297533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfdad9-9a1d-49fe-952e-355351d63ac1 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:05.298251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfdad9-9a1d-49fe-952e-355351d63ac1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:05.298556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfdad9-9a1d-49fe-952e-355351d63ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:05.300539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfdad9-9a1d-49fe-952e-355351d63ac1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:05.308629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 362/719] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Jun 28 11:56:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:06.546835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d98e2-37ca-40ba-93db-6d973c8868c0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:06.547362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d98e2-37ca-40ba-93db-6d973c8868c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:06.547484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d98e2-37ca-40ba-93db-6d973c8868c0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:06.549168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 358/720] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:06.555020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800b107-1df0-4068-b512-f7399b4cb9d3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:06.555489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800b107-1df0-4068-b512-f7399b4cb9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:06.555588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800b107-1df0-4068-b512-f7399b4cb9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:06.577943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7800b107-1df0-4068-b512-f7399b4cb9d3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:06.579127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7800b107-1df0-4068-b512-f7399b4cb9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:06.589027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:06.649709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 363/721] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:56:06.684187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d98e2-37ca-40ba-93db-6d973c8868c0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:06.714694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:06.741927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed380-7290-4f69-a89f-2cf9c6fa0db3 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:06.742258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed380-7290-4f69-a89f-2cf9c6fa0db3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:06.742489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ed380-7290-4f69-a89f-2cf9c6fa0db3 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:06.743886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 364/722] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:06.748943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0eb51-cc07-4b16-8e37-5f4e35252a29 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:06.749225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0eb51-cc07-4b16-8e37-5f4e35252a29 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:06.749502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0eb51-cc07-4b16-8e37-5f4e35252a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:06.782541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-69d0eb51-cc07-4b16-8e37-5f4e35252a29 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:06.783659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-69d0eb51-cc07-4b16-8e37-5f4e35252a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:06.857884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d98e2-37ca-40ba-93db-6d973c8868c0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:06.916867 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 365/723] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 11:56:06.921438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0815-57cd-445c-baca-8b9e5482edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:06.922231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0815-57cd-445c-baca-8b9e5482edd9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:06.922516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0815-57cd-445c-baca-8b9e5482edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:06.922792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0815-57cd-445c-baca-8b9e5482edd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:06.933828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b0815-57cd-445c-baca-8b9e5482edd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e11b0815-57cd-445c-baca-8b9e5482edd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:06.943518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:06.944491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:06.945314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 359/724] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:06.952751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0eb51-cc07-4b16-8e37-5f4e35252a29 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:06.965412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0815-57cd-445c-baca-8b9e5482edd9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:07.045627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:07.073017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0eb51-cc07-4b16-8e37-5f4e35252a29 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:07.109172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160703d1-5e86-47a7-b269-a2a3b9bdf777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:07.109851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160703d1-5e86-47a7-b269-a2a3b9bdf777 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.110137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160703d1-5e86-47a7-b269-a2a3b9bdf777 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.110409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160703d1-5e86-47a7-b269-a2a3b9bdf777 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.111200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160703d1-5e86-47a7-b269-a2a3b9bdf777 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:07.111509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160703d1-5e86-47a7-b269-a2a3b9bdf777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:07.114159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160703d1-5e86-47a7-b269-a2a3b9bdf777 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:07.122048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:07.124112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 366/725] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:07.136907 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160703d1-5e86-47a7-b269-a2a3b9bdf777 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:07.142254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0815-57cd-445c-baca-8b9e5482edd9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:07.187491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58268d6-6f9d-4e3d-a682-235222006c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:07.188875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58268d6-6f9d-4e3d-a682-235222006c64 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.189392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58268d6-6f9d-4e3d-a682-235222006c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.189921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58268d6-6f9d-4e3d-a682-235222006c64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.209506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58268d6-6f9d-4e3d-a682-235222006c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a58268d6-6f9d-4e3d-a682-235222006c64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:07.225855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:07.227175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:07.228063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 360/726] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:07.241076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58268d6-6f9d-4e3d-a682-235222006c64 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:07.261559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160703d1-5e86-47a7-b269-a2a3b9bdf777 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:07.297246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b490-8c2c-4413-a473-01edfa532b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:07.297962 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b490-8c2c-4413-a473-01edfa532b93 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.298244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b490-8c2c-4413-a473-01edfa532b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.298521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b490-8c2c-4413-a473-01edfa532b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.305493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:07.324322 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378b490-8c2c-4413-a473-01edfa532b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:07.325939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378b490-8c2c-4413-a473-01edfa532b93 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-d378b490-8c2c-4413-a473-01edfa532b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:07.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:07.358007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:07.358875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:07.358875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:07.358875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:07.358875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:07.360492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 367/727] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:07.366277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b490-8c2c-4413-a473-01edfa532b93 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:07.465082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58268d6-6f9d-4e3d-a682-235222006c64 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:07.535300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df5583-4ce8-4ce0-a774-d52ce6cf62c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:07.536026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5583-4ce8-4ce0-a774-d52ce6cf62c8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.536309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5583-4ce8-4ce0-a774-d52ce6cf62c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.536581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df5583-4ce8-4ce0-a774-d52ce6cf62c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.537403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df5583-4ce8-4ce0-a774-d52ce6cf62c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:07.537712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df5583-4ce8-4ce0-a774-d52ce6cf62c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:07.539135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df5583-4ce8-4ce0-a774-d52ce6cf62c8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:07.554923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 361/728] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:07.559841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b490-8c2c-4413-a473-01edfa532b93 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:07.565205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df5583-4ce8-4ce0-a774-d52ce6cf62c8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:07.572051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:07.602966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acfadc-e5e8-41aa-997e-2ff5a3ecb49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:07.603975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acfadc-e5e8-41aa-997e-2ff5a3ecb49e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.604444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acfadc-e5e8-41aa-997e-2ff5a3ecb49e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.604930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acfadc-e5e8-41aa-997e-2ff5a3ecb49e None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.605900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acfadc-e5e8-41aa-997e-2ff5a3ecb49e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:07.606388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acfadc-e5e8-41aa-997e-2ff5a3ecb49e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:07.607974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acfadc-e5e8-41aa-997e-2ff5a3ecb49e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:07.620826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 368/729] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:07.628869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acfadc-e5e8-41aa-997e-2ff5a3ecb49e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:07.733019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:07.787022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df5583-4ce8-4ce0-a774-d52ce6cf62c8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:07.796346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acfadc-e5e8-41aa-997e-2ff5a3ecb49e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:07.828611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1eabc-933b-4faa-a31e-1a1f6ad45030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:07.829406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1eabc-933b-4faa-a31e-1a1f6ad45030 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.829686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1eabc-933b-4faa-a31e-1a1f6ad45030 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.829959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1eabc-933b-4faa-a31e-1a1f6ad45030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.839935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efde974-9d07-48ad-b605-6d2c5683ae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:07.840993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde974-9d07-48ad-b605-6d2c5683ae58 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.841495 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde974-9d07-48ad-b605-6d2c5683ae58 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.841600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1eabc-933b-4faa-a31e-1a1f6ad45030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:07.842073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efde974-9d07-48ad-b605-6d2c5683ae58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.842989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1eabc-933b-4faa-a31e-1a1f6ad45030 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:07.850948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efde974-9d07-48ad-b605-6d2c5683ae58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:07.852962 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efde974-9d07-48ad-b605-6d2c5683ae58 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-78a1eabc-933b-4faa-a31e-1a1f6ad45030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:07.860483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:07.861353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:07.862425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:07.862425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:07.862425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:07.862425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:07.862425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 362/730] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:07.863289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9afa1-540e-4eb0-9775-c8780df48b68 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.863570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9afa1-540e-4eb0-9775-c8780df48b68 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.863842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9afa1-540e-4eb0-9775-c8780df48b68 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.865377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 363/731] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:07.866573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a3f3d-a86f-40ab-a7e2-d90fb2f4d28b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.866781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a3f3d-a86f-40ab-a7e2-d90fb2f4d28b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.867062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a3f3d-a86f-40ab-a7e2-d90fb2f4d28b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.871981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 364/732] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:07.871981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a3f3d-a86f-40ab-a7e2-d90fb2f4d28b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2efde974-9d07-48ad-b605-6d2c5683ae58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:07.874973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:07.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 369/733] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Jun 28 11:56:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89832642-7985-452c-90d9-518173c0e588 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.882102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89832642-7985-452c-90d9-518173c0e588 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.882806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89832642-7985-452c-90d9-518173c0e588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.900569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-89832642-7985-452c-90d9-518173c0e588 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:07.901741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-89832642-7985-452c-90d9-518173c0e588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:07.936343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:07.978400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 370/734] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:56:07.978400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52f9a-6fdc-47c0-b970-75f7484d9064 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:07.978400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52f9a-6fdc-47c0-b970-75f7484d9064 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:07.978400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52f9a-6fdc-47c0-b970-75f7484d9064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:07.990878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d4e52f9a-6fdc-47c0-b970-75f7484d9064 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:07.992152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d4e52f9a-6fdc-47c0-b970-75f7484d9064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:07.994705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a3f3d-a86f-40ab-a7e2-d90fb2f4d28b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:08.023748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:08.032582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78e2b1-fdcf-4917-aa98-0455f040f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:08.035171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78e2b1-fdcf-4917-aa98-0455f040f143 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.035171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78e2b1-fdcf-4917-aa98-0455f040f143 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.035171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78e2b1-fdcf-4917-aa98-0455f040f143 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.035171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78e2b1-fdcf-4917-aa98-0455f040f143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:08.035474 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78e2b1-fdcf-4917-aa98-0455f040f143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:08.036839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78e2b1-fdcf-4917-aa98-0455f040f143 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:08.048620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 365/735] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:08.049250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78e2b1-fdcf-4917-aa98-0455f040f143 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.066103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 371/736] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:56:08.067467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037b6b-5fe7-410c-9a59-9fc6e122470d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.067766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037b6b-5fe7-410c-9a59-9fc6e122470d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.068104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b037b6b-5fe7-410c-9a59-9fc6e122470d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.069415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 372/737] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:08.070100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037b6b-5fe7-410c-9a59-9fc6e122470d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.157212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78e2b1-fdcf-4917-aa98-0455f040f143 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:08.171261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b037b6b-5fe7-410c-9a59-9fc6e122470d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:08.175372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:08.192817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2daf27-7e5c-46c4-988c-85d379ede4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:08.193483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2daf27-7e5c-46c4-988c-85d379ede4ad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.193762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2daf27-7e5c-46c4-988c-85d379ede4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.194038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2daf27-7e5c-46c4-988c-85d379ede4ad None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.194956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2daf27-7e5c-46c4-988c-85d379ede4ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:08.195265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2daf27-7e5c-46c4-988c-85d379ede4ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:08.196721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2daf27-7e5c-46c4-988c-85d379ede4ad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:08.204403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2511bc3-5334-46c1-a05e-fa25907043e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:08.205194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511bc3-5334-46c1-a05e-fa25907043e6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.205485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511bc3-5334-46c1-a05e-fa25907043e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.206277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511bc3-5334-46c1-a05e-fa25907043e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.214529 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 366/738] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Jun 28 11:56:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:08.215318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2daf27-7e5c-46c4-988c-85d379ede4ad None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.219977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2511bc3-5334-46c1-a05e-fa25907043e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f2511bc3-5334-46c1-a05e-fa25907043e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:08.228589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:08.229702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:08.230532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 373/739] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:56:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:08.231214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d16f-1a66-43c0-8526-5a9db99a89c4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.231284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d16f-1a66-43c0-8526-5a9db99a89c4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.231552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d16f-1a66-43c0-8526-5a9db99a89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.247952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-03a5d16f-1a66-43c0-8526-5a9db99a89c4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:08.249139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-03a5d16f-1a66-43c0-8526-5a9db99a89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:08.271619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:08.314659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 374/740] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 11:56:08.315630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d16f-1a66-43c0-8526-5a9db99a89c4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.318710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2daf27-7e5c-46c4-988c-85d379ede4ad None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:08.352660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a70072-c69b-4e71-8ee2-39095f02f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:08.353448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a70072-c69b-4e71-8ee2-39095f02f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.353733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a70072-c69b-4e71-8ee2-39095f02f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.354005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a70072-c69b-4e71-8ee2-39095f02f8c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.360860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a70072-c69b-4e71-8ee2-39095f02f8c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:08.362479 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a70072-c69b-4e71-8ee2-39095f02f8c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-91a70072-c69b-4e71-8ee2-39095f02f8c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:08.376531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:08.377700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 367/741] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:08.378756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a70072-c69b-4e71-8ee2-39095f02f8c7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.414725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:08.414883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d16f-1a66-43c0-8526-5a9db99a89c4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:08.447512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83ace-b931-4c43-ab83-9f5e353a5c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:08.448199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83ace-b931-4c43-ab83-9f5e353a5c96 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.448481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83ace-b931-4c43-ab83-9f5e353a5c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.448754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c83ace-b931-4c43-ab83-9f5e353a5c96 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.449469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83ace-b931-4c43-ab83-9f5e353a5c96 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:08.450835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c83ace-b931-4c43-ab83-9f5e353a5c96 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:08.478261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a70072-c69b-4e71-8ee2-39095f02f8c7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:08.511708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c40bb0-0efa-4a1f-905a-ffbe329d5500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:08.512519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40bb0-0efa-4a1f-905a-ffbe329d5500 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.512803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40bb0-0efa-4a1f-905a-ffbe329d5500 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.513080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c40bb0-0efa-4a1f-905a-ffbe329d5500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.523220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c40bb0-0efa-4a1f-905a-ffbe329d5500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:08.524756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c40bb0-0efa-4a1f-905a-ffbe329d5500 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-57c40bb0-0efa-4a1f-905a-ffbe329d5500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:08.542493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:08.543506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:08.544654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:08.544654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:08.544654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:08.544654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:08.544654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 368/742] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:08.545004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c40bb0-0efa-4a1f-905a-ffbe329d5500 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.556485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 375/743] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:56:08 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:08.557298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83ace-b931-4c43-ab83-9f5e353a5c96 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.594575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:08.648886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:08.666555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c40bb0-0efa-4a1f-905a-ffbe329d5500 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:08.693331 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c83ace-b931-4c43-ab83-9f5e353a5c96 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:08.706425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d39bbb-33d8-45f5-aefc-2185d4b1e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:08.707182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d39bbb-33d8-45f5-aefc-2185d4b1e97a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.707468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d39bbb-33d8-45f5-aefc-2185d4b1e97a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.707745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d39bbb-33d8-45f5-aefc-2185d4b1e97a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.708540 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d39bbb-33d8-45f5-aefc-2185d4b1e97a None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:08.708847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d39bbb-33d8-45f5-aefc-2185d4b1e97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:08.710229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d39bbb-33d8-45f5-aefc-2185d4b1e97a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:08.720233 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 369/744] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:56:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:08.721939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d39bbb-33d8-45f5-aefc-2185d4b1e97a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.738991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7801f67-2767-4820-a871-7352da83c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:08.739994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7801f67-2767-4820-a871-7352da83c56d None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.740280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7801f67-2767-4820-a871-7352da83c56d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.740553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7801f67-2767-4820-a871-7352da83c56d None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.741285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7801f67-2767-4820-a871-7352da83c56d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:08.742665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7801f67-2767-4820-a871-7352da83c56d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:08.819649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 376/745] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:56:08 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:08.820905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7801f67-2767-4820-a871-7352da83c56d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.825677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d39bbb-33d8-45f5-aefc-2185d4b1e97a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:08.886703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e022-1ffb-488c-837a-19cf9913b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:08.887806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e022-1ffb-488c-837a-19cf9913b3eb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:08.887806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e022-1ffb-488c-837a-19cf9913b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:08.888006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738e022-1ffb-488c-837a-19cf9913b3eb None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:08.888842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e022-1ffb-488c-837a-19cf9913b3eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:08.889157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e022-1ffb-488c-837a-19cf9913b3eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:08.890641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738e022-1ffb-488c-837a-19cf9913b3eb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:08.912120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 370/746] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Jun 28 11:56:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:08.912998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e022-1ffb-488c-837a-19cf9913b3eb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:08.916112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:08.940837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:08.976710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7801f67-2767-4820-a871-7352da83c56d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.027483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d18d1-8e2c-40e8-bb1b-c4e555f757c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.028626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d18d1-8e2c-40e8-bb1b-c4e555f757c7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.029005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d18d1-8e2c-40e8-bb1b-c4e555f757c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.029287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d18d1-8e2c-40e8-bb1b-c4e555f757c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.030021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d18d1-8e2c-40e8-bb1b-c4e555f757c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:09.030328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d18d1-8e2c-40e8-bb1b-c4e555f757c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.031729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d18d1-8e2c-40e8-bb1b-c4e555f757c7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.051092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 377/747] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:09.052383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d18d1-8e2c-40e8-bb1b-c4e555f757c7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:09.067114 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738e022-1ffb-488c-837a-19cf9913b3eb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.107207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe3a47-1f8d-45d4-9831-42617fc0a986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.108030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3a47-1f8d-45d4-9831-42617fc0a986 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.108312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3a47-1f8d-45d4-9831-42617fc0a986 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.108612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe3a47-1f8d-45d4-9831-42617fc0a986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.120546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe3a47-1f8d-45d4-9831-42617fc0a986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.122005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe3a47-1f8d-45d4-9831-42617fc0a986 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-31fe3a47-1f8d-45d4-9831-42617fc0a986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:09.141417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:09.142371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:09.143744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:09.143744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:09.143744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:09.143744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:09.143744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 371/748] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:09.148488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe3a47-1f8d-45d4-9831-42617fc0a986 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:09.164566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d18d1-8e2c-40e8-bb1b-c4e555f757c7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.202448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c002ed-32ef-4f71-ba92-2ec47f77dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.203681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c002ed-32ef-4f71-ba92-2ec47f77dba2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.204213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c002ed-32ef-4f71-ba92-2ec47f77dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.204708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c002ed-32ef-4f71-ba92-2ec47f77dba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.208512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:09.208898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:09.267384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe3a47-1f8d-45d4-9831-42617fc0a986 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.285427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c002ed-32ef-4f71-ba92-2ec47f77dba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.286910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c002ed-32ef-4f71-ba92-2ec47f77dba2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.313799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00d1c7-6723-491f-9db3-4aad1f41f35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.315801 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00d1c7-6723-491f-9db3-4aad1f41f35c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.316583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00d1c7-6723-491f-9db3-4aad1f41f35c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.317106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00d1c7-6723-491f-9db3-4aad1f41f35c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.326200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00d1c7-6723-491f-9db3-4aad1f41f35c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.328432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00d1c7-6723-491f-9db3-4aad1f41f35c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8e00d1c7-6723-491f-9db3-4aad1f41f35c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:09.348720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:09.349673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:09.350581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:09.350581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:09.350581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:09.350581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:09.350581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:09.350581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:09.350581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:09.350581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:09.353022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 372/749] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:09.353889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00d1c7-6723-491f-9db3-4aad1f41f35c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:09.400142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 378/750] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:09.401003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c002ed-32ef-4f71-ba92-2ec47f77dba2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:09.436615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:09.467070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00d1c7-6723-491f-9db3-4aad1f41f35c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.482296 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:09.504246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dd2eb-93a8-4b2f-9b00-a60db14d7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.504927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dd2eb-93a8-4b2f-9b00-a60db14d7639 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.505211 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dd2eb-93a8-4b2f-9b00-a60db14d7639 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.505488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dd2eb-93a8-4b2f-9b00-a60db14d7639 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.506222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dd2eb-93a8-4b2f-9b00-a60db14d7639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:09.506440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c002ed-32ef-4f71-ba92-2ec47f77dba2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.506838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dd2eb-93a8-4b2f-9b00-a60db14d7639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.508757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dd2eb-93a8-4b2f-9b00-a60db14d7639 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.522669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 373/751] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:09.523549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dd2eb-93a8-4b2f-9b00-a60db14d7639 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:09.544211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2d9ca-8d9e-4b72-8bd9-5eb8f484adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.545252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2d9ca-8d9e-4b72-8bd9-5eb8f484adc7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.545734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2d9ca-8d9e-4b72-8bd9-5eb8f484adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.546208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2d9ca-8d9e-4b72-8bd9-5eb8f484adc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.547201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2d9ca-8d9e-4b72-8bd9-5eb8f484adc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:09.547705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2d9ca-8d9e-4b72-8bd9-5eb8f484adc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.549411 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2d9ca-8d9e-4b72-8bd9-5eb8f484adc7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.562942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 379/752] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:09.564063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2d9ca-8d9e-4b72-8bd9-5eb8f484adc7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:09.640021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dd2eb-93a8-4b2f-9b00-a60db14d7639 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.666131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:09.674169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2d9ca-8d9e-4b72-8bd9-5eb8f484adc7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.677395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e3a5-6009-4423-8ee1-e7e9d29bb025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.678200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e3a5-6009-4423-8ee1-e7e9d29bb025 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.678482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e3a5-6009-4423-8ee1-e7e9d29bb025 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.678761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e3a5-6009-4423-8ee1-e7e9d29bb025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.691494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154e3a5-6009-4423-8ee1-e7e9d29bb025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.693042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154e3a5-6009-4423-8ee1-e7e9d29bb025 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.710783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513a177-7374-4849-985f-74e6b6ac43ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.711604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513a177-7374-4849-985f-74e6b6ac43ad None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.711902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513a177-7374-4849-985f-74e6b6ac43ad None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.712223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513a177-7374-4849-985f-74e6b6ac43ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3154e3a5-6009-4423-8ee1-e7e9d29bb025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:09.713561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:09.714394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:09.715285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:09.715285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:09.715285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:09.715285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:09.719748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 374/753] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:09.720548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513a177-7374-4849-985f-74e6b6ac43ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.720655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e3a5-6009-4423-8ee1-e7e9d29bb025 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:09.722760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513a177-7374-4849-985f-74e6b6ac43ad None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b513a177-7374-4849-985f-74e6b6ac43ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:09.739223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:09.740309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:09.741279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 380/754] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:56:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:09.741864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513a177-7374-4849-985f-74e6b6ac43ad None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:09.752323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:09.832125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e3a5-6009-4423-8ee1-e7e9d29bb025 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.847291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513a177-7374-4849-985f-74e6b6ac43ad None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:09.869259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6d51b-9859-4498-bdc7-9435d44f7fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.870223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d51b-9859-4498-bdc7-9435d44f7fbb None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.870506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d51b-9859-4498-bdc7-9435d44f7fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.870781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d51b-9859-4498-bdc7-9435d44f7fbb None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/fbfe6b7a82f746169a39976be263aa29/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.873101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6d51b-9859-4498-bdc7-9435d44f7fbb None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=fbfe6b7a82f746169a39976be263aa29, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.874645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6d51b-9859-4498-bdc7-9435d44f7fbb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.884035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70820542-10b2-4ddd-bbbc-7e848d17a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:09.884701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70820542-10b2-4ddd-bbbc-7e848d17a194 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:09.884985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70820542-10b2-4ddd-bbbc-7e848d17a194 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:09.885262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70820542-10b2-4ddd-bbbc-7e848d17a194 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:09.885991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70820542-10b2-4ddd-bbbc-7e848d17a194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:09.886299 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70820542-10b2-4ddd-bbbc-7e848d17a194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:09.887661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70820542-10b2-4ddd-bbbc-7e848d17a194 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:09.900153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 381/755] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:09.901031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70820542-10b2-4ddd-bbbc-7e848d17a194 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:09.917172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:09.991612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 375/756] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:56:09 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/fbfe6b7a82f746169a39976be263aa29/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:56:09.993017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6d51b-9859-4498-bdc7-9435d44f7fbb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:10.027346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70820542-10b2-4ddd-bbbc-7e848d17a194 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:10.105086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329c659-8695-4969-925c-d5a5b4929199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:10.105790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329c659-8695-4969-925c-d5a5b4929199 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:10.106073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329c659-8695-4969-925c-d5a5b4929199 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:10.106424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329c659-8695-4969-925c-d5a5b4929199 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:10.107593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329c659-8695-4969-925c-d5a5b4929199 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:10.107928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329c659-8695-4969-925c-d5a5b4929199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:10.110641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329c659-8695-4969-925c-d5a5b4929199 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:10.150978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 382/757] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Jun 28 11:56:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:10.155975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329c659-8695-4969-925c-d5a5b4929199 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:10.175476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:10.203524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6d51b-9859-4498-bdc7-9435d44f7fbb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:10.244050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb04f0-1784-47a0-8528-617ada823570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:10.245158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb04f0-1784-47a0-8528-617ada823570 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:10.246502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb04f0-1784-47a0-8528-617ada823570 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:10.246964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb04f0-1784-47a0-8528-617ada823570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:10.254308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb04f0-1784-47a0-8528-617ada823570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:10.256026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb04f0-1784-47a0-8528-617ada823570 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:10.266566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c5fb04f0-1784-47a0-8528-617ada823570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:10.271235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:10.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:10.274198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:10.274198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:10.274198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:10.274198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:10.274198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:10.274198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:10.274198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:10.274198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:10.275395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 376/758] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:10.283308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb04f0-1784-47a0-8528-617ada823570 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:10.310138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329c659-8695-4969-925c-d5a5b4929199 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:10.385188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1aa8e-d700-4829-b657-7590e7203cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:10.385858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1aa8e-d700-4829-b657-7590e7203cac None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:10.386143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1aa8e-d700-4829-b657-7590e7203cac None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:10.386423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1aa8e-d700-4829-b657-7590e7203cac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:10.416802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb04f0-1784-47a0-8528-617ada823570 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:10.453058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4567df6-2f55-4507-8a5d-9e343c84aa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:10.453741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4567df6-2f55-4507-8a5d-9e343c84aa2c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:10.454033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4567df6-2f55-4507-8a5d-9e343c84aa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:10.454460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4567df6-2f55-4507-8a5d-9e343c84aa2c None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:10.455263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4567df6-2f55-4507-8a5d-9e343c84aa2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:10.456490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4567df6-2f55-4507-8a5d-9e343c84aa2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:10.457984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4567df6-2f55-4507-8a5d-9e343c84aa2c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:10.472619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 377/759] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:10.485074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4567df6-2f55-4507-8a5d-9e343c84aa2c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:10.498643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:10.510575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1aa8e-d700-4829-b657-7590e7203cac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:10.512069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1aa8e-d700-4829-b657-7590e7203cac None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:10.585737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:10.619332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 383/760] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:10.624733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1aa8e-d700-4829-b657-7590e7203cac None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:10.706254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4567df6-2f55-4507-8a5d-9e343c84aa2c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:10.764604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4481-e342-4b5e-870d-bccb75b56a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:10.765178 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4481-e342-4b5e-870d-bccb75b56a45 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:10.765458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4481-e342-4b5e-870d-bccb75b56a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:10.765730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4481-e342-4b5e-870d-bccb75b56a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:10.766562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4481-e342-4b5e-870d-bccb75b56a45 None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=66e90e70937d49c8a35928fcfc90972d) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:10.766873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4481-e342-4b5e-870d-bccb75b56a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:10.768991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4481-e342-4b5e-870d-bccb75b56a45 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:10.772975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1aa8e-d700-4829-b657-7590e7203cac None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:10.775042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 378/761] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:10 2022] GET /identity/v3/role_assignments?user.id=66e90e70937d49c8a35928fcfc90972d&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:10.776426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2855ff-7883-4a67-9dcd-2f9b05c97b0b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:10.776721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2855ff-7883-4a67-9dcd-2f9b05c97b0b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:10.776999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2855ff-7883-4a67-9dcd-2f9b05c97b0b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:10.782824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 379/762] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:10.784947 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fdfc3-313a-451c-8e81-31aae32fa9fc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:10.785263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fdfc3-313a-451c-8e81-31aae32fa9fc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:10.785548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fdfc3-313a-451c-8e81-31aae32fa9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:10.816448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ed600-4583-4e2b-aadb-e0fe8a37b991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:10.817280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ed600-4583-4e2b-aadb-e0fe8a37b991 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:10.817620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ed600-4583-4e2b-aadb-e0fe8a37b991 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:10.817902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ed600-4583-4e2b-aadb-e0fe8a37b991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:10.829062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6d8fdfc3-313a-451c-8e81-31aae32fa9fc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:10.830227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ed600-4583-4e2b-aadb-e0fe8a37b991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:10.830336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6d8fdfc3-313a-451c-8e81-31aae32fa9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:10.832515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ed600-4583-4e2b-aadb-e0fe8a37b991 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-662ed600-4583-4e2b-aadb-e0fe8a37b991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:10.854129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:10.855080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:10.856669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:10.856669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:10.856669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:10.856669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:10.856669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 384/763] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:10.861487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ed600-4583-4e2b-aadb-e0fe8a37b991 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:10.927643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:10.932244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:10.940897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 380/764] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:10.976949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fdfc3-313a-451c-8e81-31aae32fa9fc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:11.019408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ed600-4583-4e2b-aadb-e0fe8a37b991 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:11.065761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b435a1d-22d6-4611-953d-ad62023f5a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:11.066468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b435a1d-22d6-4611-953d-ad62023f5a8d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.066758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b435a1d-22d6-4611-953d-ad62023f5a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.067039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b435a1d-22d6-4611-953d-ad62023f5a8d None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.067773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b435a1d-22d6-4611-953d-ad62023f5a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:11.069560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b435a1d-22d6-4611-953d-ad62023f5a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:11.071919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b435a1d-22d6-4611-953d-ad62023f5a8d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:11.095359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 385/765] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:11.103243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b435a1d-22d6-4611-953d-ad62023f5a8d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:11.167772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fdfc3-313a-451c-8e81-31aae32fa9fc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:11.206377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e10df-de69-49ea-9e0d-dcd17c0ba059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:11.207280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e10df-de69-49ea-9e0d-dcd17c0ba059 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.207675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e10df-de69-49ea-9e0d-dcd17c0ba059 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.208054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e10df-de69-49ea-9e0d-dcd17c0ba059 None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.208719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e10df-de69-49ea-9e0d-dcd17c0ba059 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:11.210105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e10df-de69-49ea-9e0d-dcd17c0ba059 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e22e10df-de69-49ea-9e0d-dcd17c0ba059 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:11.223236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:11.224265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:11.225534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 381/766] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:10 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:11.226574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e2551-adcd-4f6b-890b-ba282b4bb9f2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.226888 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e2551-adcd-4f6b-890b-ba282b4bb9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.227042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e2551-adcd-4f6b-890b-ba282b4bb9f2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.229575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 382/767] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:11.233117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e2551-adcd-4f6b-890b-ba282b4bb9f2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:11.237240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:11.259488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b435a1d-22d6-4611-953d-ad62023f5a8d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:11.306472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:11.309976 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7732cb-e0ae-4f65-b955-c13b871fdd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:11.310820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7732cb-e0ae-4f65-b955-c13b871fdd9a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.311105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7732cb-e0ae-4f65-b955-c13b871fdd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.311385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7732cb-e0ae-4f65-b955-c13b871fdd9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.321975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7732cb-e0ae-4f65-b955-c13b871fdd9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:11.323478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7732cb-e0ae-4f65-b955-c13b871fdd9a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-bf7732cb-e0ae-4f65-b955-c13b871fdd9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:11.342327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:11.343264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:11.344180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:11.344180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:11.344180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:11.344180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:11.344180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:11.344180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:11.344180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:11.344180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:11.346688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 386/768] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:11.348203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c71eb-e3d7-480a-a829-1ecf0391e2ee None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.348749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c71eb-e3d7-480a-a829-1ecf0391e2ee None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.349230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c71eb-e3d7-480a-a829-1ecf0391e2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.366176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e2551-adcd-4f6b-890b-ba282b4bb9f2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:11.370415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-592c71eb-e3d7-480a-a829-1ecf0391e2ee None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:11.371854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-592c71eb-e3d7-480a-a829-1ecf0391e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:11.412581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3df3b-1c57-4e98-902f-971bdb4a8215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:11.413893 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3df3b-1c57-4e98-902f-971bdb4a8215 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.415285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3df3b-1c57-4e98-902f-971bdb4a8215 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.415781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3df3b-1c57-4e98-902f-971bdb4a8215 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.416751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3df3b-1c57-4e98-902f-971bdb4a8215 None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:11.417273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3df3b-1c57-4e98-902f-971bdb4a8215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:11.418865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3df3b-1c57-4e98-902f-971bdb4a8215 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:11.426844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 383/769] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:11.428768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3df3b-1c57-4e98-902f-971bdb4a8215 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:11.450629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 387/770] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:11.456462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c71eb-e3d7-480a-a829-1ecf0391e2ee None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:11.547103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:11.551724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3df3b-1c57-4e98-902f-971bdb4a8215 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:11.575691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c71eb-e3d7-480a-a829-1ecf0391e2ee None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:11.581272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:11.590441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552ac30-53d8-407d-9f1c-17ab81c0abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:11.593837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552ac30-53d8-407d-9f1c-17ab81c0abd7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.593837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552ac30-53d8-407d-9f1c-17ab81c0abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.593837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552ac30-53d8-407d-9f1c-17ab81c0abd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.593837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552ac30-53d8-407d-9f1c-17ab81c0abd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:11.593837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552ac30-53d8-407d-9f1c-17ab81c0abd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:11.595907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552ac30-53d8-407d-9f1c-17ab81c0abd7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:11.610121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 384/771] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:11.611271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552ac30-53d8-407d-9f1c-17ab81c0abd7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:11.619574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fab43-a93f-48a6-9d92-17c28101252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:11.620839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fab43-a93f-48a6-9d92-17c28101252a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.620839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fab43-a93f-48a6-9d92-17c28101252a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.620839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fab43-a93f-48a6-9d92-17c28101252a None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.621557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fab43-a93f-48a6-9d92-17c28101252a None admin] RBAC: Adding query filter params (type=network) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:11.621869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fab43-a93f-48a6-9d92-17c28101252a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:11.623254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fab43-a93f-48a6-9d92-17c28101252a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:11.630240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 388/772] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:11.631161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fab43-a93f-48a6-9d92-17c28101252a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:11.730201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552ac30-53d8-407d-9f1c-17ab81c0abd7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:11.734506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fab43-a93f-48a6-9d92-17c28101252a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:11.777092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a79ca-8436-4814-8df2-9e81e26038bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:11.777865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a79ca-8436-4814-8df2-9e81e26038bd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.778033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a79ca-8436-4814-8df2-9e81e26038bd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.778315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a79ca-8436-4814-8df2-9e81e26038bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.779260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a79ca-8436-4814-8df2-9e81e26038bd None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=a633011057f643218e20293412f8108f) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:11.779582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a79ca-8436-4814-8df2-9e81e26038bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:11.781214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a79ca-8436-4814-8df2-9e81e26038bd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:11.782632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448c925-ff2a-4d3e-b205-714e0758ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:11.783721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448c925-ff2a-4d3e-b205-714e0758ee8f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.784298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448c925-ff2a-4d3e-b205-714e0758ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.784940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448c925-ff2a-4d3e-b205-714e0758ee8f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:11.785824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448c925-ff2a-4d3e-b205-714e0758ee8f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:11.787391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448c925-ff2a-4d3e-b205-714e0758ee8f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:11.792141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 389/773] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:11 2022] GET /identity/v3/role_assignments?user.id=a633011057f643218e20293412f8108f&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:11.793074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a79ca-8436-4814-8df2-9e81e26038bd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:11.802967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0448c925-ff2a-4d3e-b205-714e0758ee8f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:11.811262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:11.812252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 11:56:11.813146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:11.819852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 385/774] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Jun 28 11:56:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:11.835432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448c925-ff2a-4d3e-b205-714e0758ee8f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:11.900371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:11.956643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448c925-ff2a-4d3e-b205-714e0758ee8f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:11.997558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54683b7d-4f78-4694-9e7a-0811e94b9781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:11.998554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54683b7d-4f78-4694-9e7a-0811e94b9781 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:11.999025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54683b7d-4f78-4694-9e7a-0811e94b9781 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:11.999516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54683b7d-4f78-4694-9e7a-0811e94b9781 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:12.002111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54683b7d-4f78-4694-9e7a-0811e94b9781 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:12.002935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54683b7d-4f78-4694-9e7a-0811e94b9781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:12.004592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54683b7d-4f78-4694-9e7a-0811e94b9781 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:12.021958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 386/775] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Jun 28 11:56:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:12.029295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a79ca-8436-4814-8df2-9e81e26038bd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:12.032914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54683b7d-4f78-4694-9e7a-0811e94b9781 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:12.095407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15bd62-0703-4336-8bb9-807fe7b22bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:12.096540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15bd62-0703-4336-8bb9-807fe7b22bcf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:12.097054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15bd62-0703-4336-8bb9-807fe7b22bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:12.097605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15bd62-0703-4336-8bb9-807fe7b22bcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:12.098638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15bd62-0703-4336-8bb9-807fe7b22bcf None admin] RBAC: Adding query filter params (interface=public, service_id=857ecae171a449b18ef41bd8d4b9d092, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:12.099208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15bd62-0703-4336-8bb9-807fe7b22bcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:12.107267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15bd62-0703-4336-8bb9-807fe7b22bcf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:12.128691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 390/776] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Jun 28 11:56:11 2022] GET /identity/v3/endpoints?service_id=857ecae171a449b18ef41bd8d4b9d092&interface=public®ion_id=RegionOne => generated 194 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:12.136403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15bd62-0703-4336-8bb9-807fe7b22bcf None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:12.231613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54683b7d-4f78-4694-9e7a-0811e94b9781 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:12.251364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:12.280616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416df615-a313-4217-a4cd-1f08561cd8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:12.281767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416df615-a313-4217-a4cd-1f08561cd8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:12.282258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416df615-a313-4217-a4cd-1f08561cd8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:12.282764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416df615-a313-4217-a4cd-1f08561cd8d8 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:12.284260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416df615-a313-4217-a4cd-1f08561cd8d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:12.284874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416df615-a313-4217-a4cd-1f08561cd8d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:12.286736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416df615-a313-4217-a4cd-1f08561cd8d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:12.300813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 387/777] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Jun 28 11:56:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:12.305782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416df615-a313-4217-a4cd-1f08561cd8d8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:12.323249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:12.399645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15bd62-0703-4336-8bb9-807fe7b22bcf None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:12.478177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07f18-25ee-408f-8b28-cd576c1ce1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:12.479172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07f18-25ee-408f-8b28-cd576c1ce1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:12.479527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07f18-25ee-408f-8b28-cd576c1ce1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:12.479825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07f18-25ee-408f-8b28-cd576c1ce1b0 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:12.480508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07f18-25ee-408f-8b28-cd576c1ce1b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:12.481897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07f18-25ee-408f-8b28-cd576c1ce1b0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:12.504223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 391/778] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Jun 28 11:56:12 2022] GET /identity/v3/services => generated 772 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:12.505636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2a3c-e58f-4342-b8a2-a0e72644b397 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:12.505931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2a3c-e58f-4342-b8a2-a0e72644b397 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:12.506244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2a3c-e58f-4342-b8a2-a0e72644b397 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:12.509567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416df615-a313-4217-a4cd-1f08561cd8d8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:12.521029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 392/779] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:12.525477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533f2e0-ed3d-4813-ad3f-b499589e4039 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:12.532134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533f2e0-ed3d-4813-ad3f-b499589e4039 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:12.532134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533f2e0-ed3d-4813-ad3f-b499589e4039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:12.579915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b767d-de81-400a-918e-79dc516935ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:12.579915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b767d-de81-400a-918e-79dc516935ad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:12.579915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b767d-de81-400a-918e-79dc516935ad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:12.579915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b767d-de81-400a-918e-79dc516935ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:12.581000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b767d-de81-400a-918e-79dc516935ad None admin] RBAC: Adding query filter params (interface=public, service_id=70e6d171ac634d328e8806b451d64fc9, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:12.581000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b767d-de81-400a-918e-79dc516935ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:12.587896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b767d-de81-400a-918e-79dc516935ad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:12.588083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a533f2e0-ed3d-4813-ad3f-b499589e4039 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:12.591896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a533f2e0-ed3d-4813-ad3f-b499589e4039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:12.617661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 388/780] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Jun 28 11:56:12 2022] GET /identity/v3/endpoints?service_id=70e6d171ac634d328e8806b451d64fc9&interface=public®ion_id=RegionOne => generated 194 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:12.623109 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b767d-de81-400a-918e-79dc516935ad None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:12.743541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:12.776593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 393/781] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:12.804585 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533f2e0-ed3d-4813-ad3f-b499589e4039 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:12.820715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b767d-de81-400a-918e-79dc516935ad None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:12.914566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:12.916981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc055a-3f80-4288-9804-2b2c222c991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:12.918170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc055a-3f80-4288-9804-2b2c222c991c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:12.918170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc055a-3f80-4288-9804-2b2c222c991c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:12.918320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc055a-3f80-4288-9804-2b2c222c991c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:12.918895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc055a-3f80-4288-9804-2b2c222c991c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:12.920308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc055a-3f80-4288-9804-2b2c222c991c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:12.930899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 389/782] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Jun 28 11:56:12 2022] GET /identity/v3/services => generated 772 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:12.977712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533f2e0-ed3d-4813-ad3f-b499589e4039 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:13.026156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ea94b-138a-4ee6-bea8-3c92d9c3c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:13.027373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea94b-138a-4ee6-bea8-3c92d9c3c004 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:13.027890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea94b-138a-4ee6-bea8-3c92d9c3c004 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:13.028397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea94b-138a-4ee6-bea8-3c92d9c3c004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:13.043904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ea94b-138a-4ee6-bea8-3c92d9c3c004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-113ea94b-138a-4ee6-bea8-3c92d9c3c004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:13.053555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:13.054581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:13.055421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:13.058419 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 394/783] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:13.064397 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc055a-3f80-4288-9804-2b2c222c991c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:13.188677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70a39f-2aff-455b-85c0-35b9610d4ab8 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:13.189350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70a39f-2aff-455b-85c0-35b9610d4ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:13.190252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70a39f-2aff-455b-85c0-35b9610d4ab8 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:13.192649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 395/784] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:13.203313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b710fb-a329-483a-9817-c71f5df92fe6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:13.203610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b710fb-a329-483a-9817-c71f5df92fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:13.206820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b710fb-a329-483a-9817-c71f5df92fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:13.230009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-01b710fb-a329-483a-9817-c71f5df92fe6 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:13.231409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-01b710fb-a329-483a-9817-c71f5df92fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:13.243482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc055a-3f80-4288-9804-2b2c222c991c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:13.253114 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:13.286690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e37ac-b4d7-4002-af3c-15ff914c54b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:13.287297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e37ac-b4d7-4002-af3c-15ff914c54b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:13.287584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e37ac-b4d7-4002-af3c-15ff914c54b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:13.288324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e37ac-b4d7-4002-af3c-15ff914c54b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:13.289027 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e37ac-b4d7-4002-af3c-15ff914c54b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:13.289350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e37ac-b4d7-4002-af3c-15ff914c54b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:13.291713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e37ac-b4d7-4002-af3c-15ff914c54b4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:13.306016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 390/785] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:13.317848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e37ac-b4d7-4002-af3c-15ff914c54b4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:13.349367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 396/786] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:13.398242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b710fb-a329-483a-9817-c71f5df92fe6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:13.488497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:13.500409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e37ac-b4d7-4002-af3c-15ff914c54b4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:13.560451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b710fb-a329-483a-9817-c71f5df92fe6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:13.574349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb4912-54c6-4f6a-9317-0b65a1f15027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:13.575019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb4912-54c6-4f6a-9317-0b65a1f15027 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:13.575310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb4912-54c6-4f6a-9317-0b65a1f15027 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:13.575591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb4912-54c6-4f6a-9317-0b65a1f15027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:13.588054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb4912-54c6-4f6a-9317-0b65a1f15027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:13.589532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb4912-54c6-4f6a-9317-0b65a1f15027 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:13.601825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ecce1-1276-45ac-9c8d-511f5f9be1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:13.602890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ecce1-1276-45ac-9c8d-511f5f9be1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:13.603547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ecce1-1276-45ac-9c8d-511f5f9be1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:13.604062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ecce1-1276-45ac-9c8d-511f5f9be1d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:13.615262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ecce1-1276-45ac-9c8d-511f5f9be1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c6cb4912-54c6-4f6a-9317-0b65a1f15027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:13.629925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:13.630833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:13.632375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:13.632375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:13.632375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:13.632375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:13.632375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 391/787] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-334ecce1-1276-45ac-9c8d-511f5f9be1d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:13.632838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:13.633644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:13.634480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 397/788] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:13.637341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb4912-54c6-4f6a-9317-0b65a1f15027 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:13.641536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ecce1-1276-45ac-9c8d-511f5f9be1d6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:13.699322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:13.793299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb4912-54c6-4f6a-9317-0b65a1f15027 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:13.832664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4915d-68a1-41ca-9846-fdac398c113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:13.833746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4915d-68a1-41ca-9846-fdac398c113b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:13.834044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4915d-68a1-41ca-9846-fdac398c113b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:13.834377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4915d-68a1-41ca-9846-fdac398c113b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:13.835180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4915d-68a1-41ca-9846-fdac398c113b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:13.835503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4915d-68a1-41ca-9846-fdac398c113b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:13.837127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4915d-68a1-41ca-9846-fdac398c113b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:13.850238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 392/789] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:13.856037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4915d-68a1-41ca-9846-fdac398c113b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:13.909861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ecce1-1276-45ac-9c8d-511f5f9be1d6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:13.937347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:13.967070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4915d-68a1-41ca-9846-fdac398c113b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:13.980266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:14.008527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07947-1168-4098-b474-8a4cacad6ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:14.009591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07947-1168-4098-b474-8a4cacad6ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.009951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07947-1168-4098-b474-8a4cacad6ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.010301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07947-1168-4098-b474-8a4cacad6ed1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.019655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e07947-1168-4098-b474-8a4cacad6ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:14.021232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e07947-1168-4098-b474-8a4cacad6ed1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:14.035604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5ebb2-baee-469d-a8f2-784ccaa61e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:14.036331 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5ebb2-baee-469d-a8f2-784ccaa61e6c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.036613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5ebb2-baee-469d-a8f2-784ccaa61e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.036889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5ebb2-baee-469d-a8f2-784ccaa61e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.037649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5ebb2-baee-469d-a8f2-784ccaa61e6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:14.037957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5ebb2-baee-469d-a8f2-784ccaa61e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:14.039327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5ebb2-baee-469d-a8f2-784ccaa61e6c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b7e07947-1168-4098-b474-8a4cacad6ed1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:14.043393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:14.044460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:14.045381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 393/790] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Jun 28 11:56:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:14.051644 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07947-1168-4098-b474-8a4cacad6ed1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:14.058701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 398/791] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:14.069747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5ebb2-baee-469d-a8f2-784ccaa61e6c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:14.249367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07947-1168-4098-b474-8a4cacad6ed1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:14.254663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5ebb2-baee-469d-a8f2-784ccaa61e6c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:14.315903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2900316-0553-40c6-8811-72f0798d8477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:14.317759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900316-0553-40c6-8811-72f0798d8477 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.319120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900316-0553-40c6-8811-72f0798d8477 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.319553 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900316-0553-40c6-8811-72f0798d8477 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.320347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f2f3d-5819-476d-894c-c68f6b1f76e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:14.321357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2900316-0553-40c6-8811-72f0798d8477 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:14.322310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f2f3d-5819-476d-894c-c68f6b1f76e8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.322771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2900316-0553-40c6-8811-72f0798d8477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:14.323192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f2f3d-5819-476d-894c-c68f6b1f76e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.324285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f2f3d-5819-476d-894c-c68f6b1f76e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.325147 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2900316-0553-40c6-8811-72f0798d8477 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:14.343536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:14.345051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f2f3d-5819-476d-894c-c68f6b1f76e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:14.346795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f2f3d-5819-476d-894c-c68f6b1f76e8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:14.350344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 394/792] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Jun 28 11:56:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:14.352187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cd0d7-fe8e-412d-a904-d05911d34e4f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.352661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cd0d7-fe8e-412d-a904-d05911d34e4f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.353119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cd0d7-fe8e-412d-a904-d05911d34e4f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.355256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 395/793] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:14.357034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cd0d7-fe8e-412d-a904-d05911d34e4f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5c5f2f3d-5819-476d-894c-c68f6b1f76e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:14.366990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:14.367910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:14.368792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:14.368792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:14.368792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:14.368792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:14.368792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 399/794] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:14.374567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094cd70-910f-4881-91f9-b3ce1b71745a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.374933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094cd70-910f-4881-91f9-b3ce1b71745a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.375344 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094cd70-910f-4881-91f9-b3ce1b71745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.393595 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0094cd70-910f-4881-91f9-b3ce1b71745a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:14.394879 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0094cd70-910f-4881-91f9-b3ce1b71745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:14.414267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:14.468415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 400/795] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:14.469473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094cd70-910f-4881-91f9-b3ce1b71745a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:14.490498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cd0d7-fe8e-412d-a904-d05911d34e4f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:14.535192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2752399-a6fe-4fd5-a345-b0b3a8e1e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:14.535859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2752399-a6fe-4fd5-a345-b0b3a8e1e566 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.536163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2752399-a6fe-4fd5-a345-b0b3a8e1e566 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.536442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2752399-a6fe-4fd5-a345-b0b3a8e1e566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.603175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094cd70-910f-4881-91f9-b3ce1b71745a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:14.616187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:14.619489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2752399-a6fe-4fd5-a345-b0b3a8e1e566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:14.624077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2752399-a6fe-4fd5-a345-b0b3a8e1e566 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:14.646647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a68075-768c-4b7c-98c4-6af50334c367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:14.647564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a68075-768c-4b7c-98c4-6af50334c367 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.648045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a68075-768c-4b7c-98c4-6af50334c367 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.648471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a68075-768c-4b7c-98c4-6af50334c367 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.649377 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a68075-768c-4b7c-98c4-6af50334c367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:14.649835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a68075-768c-4b7c-98c4-6af50334c367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:14.651422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a68075-768c-4b7c-98c4-6af50334c367 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:14.668134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 401/796] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:14.669235 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a68075-768c-4b7c-98c4-6af50334c367 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:14.687601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:14.752882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 396/797] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:14.753801 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2752399-a6fe-4fd5-a345-b0b3a8e1e566 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:14.778119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a68075-768c-4b7c-98c4-6af50334c367 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:14.815398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a55c-b246-4fce-8584-cf462f14751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:14.816481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a55c-b246-4fce-8584-cf462f14751f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.816917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a55c-b246-4fce-8584-cf462f14751f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.817343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a55c-b246-4fce-8584-cf462f14751f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.828229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11a55c-b246-4fce-8584-cf462f14751f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-1c11a55c-b246-4fce-8584-cf462f14751f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:14.836158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:14.837291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:56:14.838275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:14.840537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 402/798] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:56:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:14.841575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a55c-b246-4fce-8584-cf462f14751f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:14.873258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:14.878154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2752399-a6fe-4fd5-a345-b0b3a8e1e566 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:14.919200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2c12c-bc4b-4f72-9891-c978633cfeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:14.920380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2c12c-bc4b-4f72-9891-c978633cfeed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:14.920852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2c12c-bc4b-4f72-9891-c978633cfeed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:14.921309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2c12c-bc4b-4f72-9891-c978633cfeed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:14.929486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2c12c-bc4b-4f72-9891-c978633cfeed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:14.931211 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2c12c-bc4b-4f72-9891-c978633cfeed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:14.942230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9bd2c12c-bc4b-4f72-9891-c978633cfeed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:14.946447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:14.947364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:14.948341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 397/799] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:14.949262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2c12c-bc4b-4f72-9891-c978633cfeed None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:14.976806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a55c-b246-4fce-8584-cf462f14751f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.012621 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9297198-66a8-4415-90f2-0b08f0b8a6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.013417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9297198-66a8-4415-90f2-0b08f0b8a6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.013703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9297198-66a8-4415-90f2-0b08f0b8a6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.013980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9297198-66a8-4415-90f2-0b08f0b8a6b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.025976 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9297198-66a8-4415-90f2-0b08f0b8a6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.027430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9297198-66a8-4415-90f2-0b08f0b8a6b0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e9297198-66a8-4415-90f2-0b08f0b8a6b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:15.045703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:15.046640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:15.047525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:15.047525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:15.047525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:15.047525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:15.051632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 403/800] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:15.052978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47d03-f197-4580-91c6-f3af437d2384 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.053268 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47d03-f197-4580-91c6-f3af437d2384 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.053545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47d03-f197-4580-91c6-f3af437d2384 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.054831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 404/801] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:15.055590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47d03-f197-4580-91c6-f3af437d2384 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.064911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2c12c-bc4b-4f72-9891-c978633cfeed None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.102873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe7b7a-6228-4850-8f45-9ad2ebf1340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.103540 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe7b7a-6228-4850-8f45-9ad2ebf1340d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.103998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe7b7a-6228-4850-8f45-9ad2ebf1340d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.104200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe7b7a-6228-4850-8f45-9ad2ebf1340d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.105002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe7b7a-6228-4850-8f45-9ad2ebf1340d None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:15.105237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe7b7a-6228-4850-8f45-9ad2ebf1340d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.106697 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe7b7a-6228-4850-8f45-9ad2ebf1340d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.120035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 398/802] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:56:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:15.120035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe7b7a-6228-4850-8f45-9ad2ebf1340d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.144953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:15.171892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47d03-f197-4580-91c6-f3af437d2384 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.202806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:15.212569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6257a-9651-40c6-a241-bc7e1edd2e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.213346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6257a-9651-40c6-a241-bc7e1edd2e88 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.213738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6257a-9651-40c6-a241-bc7e1edd2e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.214185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6257a-9651-40c6-a241-bc7e1edd2e88 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.215119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6257a-9651-40c6-a241-bc7e1edd2e88 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:15.215459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6257a-9651-40c6-a241-bc7e1edd2e88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.216981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6257a-9651-40c6-a241-bc7e1edd2e88 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.228999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe7b7a-6228-4850-8f45-9ad2ebf1340d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.240900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 405/803] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:15.240900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d97b71-b5d5-4593-9bc3-86bcbed74735 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.240900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d97b71-b5d5-4593-9bc3-86bcbed74735 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.240900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d97b71-b5d5-4593-9bc3-86bcbed74735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.257554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-53d97b71-b5d5-4593-9bc3-86bcbed74735 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:15.258749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-53d97b71-b5d5-4593-9bc3-86bcbed74735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:15.266077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1ddcc-0e4e-4f18-89a2-0577b36c9581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.266747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1ddcc-0e4e-4f18-89a2-0577b36c9581 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.267034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1ddcc-0e4e-4f18-89a2-0577b36c9581 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.267311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1ddcc-0e4e-4f18-89a2-0577b36c9581 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.268191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1ddcc-0e4e-4f18-89a2-0577b36c9581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:15.268551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1ddcc-0e4e-4f18-89a2-0577b36c9581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.269910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1ddcc-0e4e-4f18-89a2-0577b36c9581 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.286512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 399/804] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:15.286512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1ddcc-0e4e-4f18-89a2-0577b36c9581 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.337408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 406/805] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:15.338274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d97b71-b5d5-4593-9bc3-86bcbed74735 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.379809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:15.398541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1ddcc-0e4e-4f18-89a2-0577b36c9581 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.444678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43a5da-edfd-4e53-8865-af18d54ad87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.446169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43a5da-edfd-4e53-8865-af18d54ad87e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.446461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43a5da-edfd-4e53-8865-af18d54ad87e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.446742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43a5da-edfd-4e53-8865-af18d54ad87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.453768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d97b71-b5d5-4593-9bc3-86bcbed74735 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.459008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43a5da-edfd-4e53-8865-af18d54ad87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.460497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43a5da-edfd-4e53-8865-af18d54ad87e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.469436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cb43a5da-edfd-4e53-8865-af18d54ad87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:15.480142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:15.481065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:15.481977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:15.481977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:15.481977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:15.481977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:15.481977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 400/806] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:15.482275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43a5da-edfd-4e53-8865-af18d54ad87e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.495565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720dce-76c7-47e2-9118-cbccded31324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.497150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720dce-76c7-47e2-9118-cbccded31324 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.497907 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720dce-76c7-47e2-9118-cbccded31324 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.498419 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720dce-76c7-47e2-9118-cbccded31324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.513358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d720dce-76c7-47e2-9118-cbccded31324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.514958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d720dce-76c7-47e2-9118-cbccded31324 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0d720dce-76c7-47e2-9118-cbccded31324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:15.533890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:15.534947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:15.535830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:15.535830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:15.535830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:15.535830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:15.535830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 407/807] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:15.536497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720dce-76c7-47e2-9118-cbccded31324 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.589913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43a5da-edfd-4e53-8865-af18d54ad87e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.623493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff5101-e74c-40bd-a261-0024aa50d59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.624317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff5101-e74c-40bd-a261-0024aa50d59d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.624597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff5101-e74c-40bd-a261-0024aa50d59d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.624872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff5101-e74c-40bd-a261-0024aa50d59d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.626766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:15.632893 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff5101-e74c-40bd-a261-0024aa50d59d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.634110 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720dce-76c7-47e2-9118-cbccded31324 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.634288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff5101-e74c-40bd-a261-0024aa50d59d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2fff5101-e74c-40bd-a261-0024aa50d59d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:15.650563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:15.651475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:15.652390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:15.652390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:15.652390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:15.652390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:15.652390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:15.652390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:15.652390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:15.652390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:15.652390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 401/808] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:15.653230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff5101-e74c-40bd-a261-0024aa50d59d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.670391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb2f8c-c873-4bb1-a13c-f9c7d94cc4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.671178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb2f8c-c873-4bb1-a13c-f9c7d94cc4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.671454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb2f8c-c873-4bb1-a13c-f9c7d94cc4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.671721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb2f8c-c873-4bb1-a13c-f9c7d94cc4c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.672399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb2f8c-c873-4bb1-a13c-f9c7d94cc4c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.673760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb2f8c-c873-4bb1-a13c-f9c7d94cc4c1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-aedb2f8c-c873-4bb1-a13c-f9c7d94cc4c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:15.685831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:15.687038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:15.688044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 408/809] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:15.688839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ecb6-c791-4fad-a416-21ecc1f20bbc None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.688839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ecb6-c791-4fad-a416-21ecc1f20bbc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.689056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ecb6-c791-4fad-a416-21ecc1f20bbc None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.691252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 409/810] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:15.691736 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095ecb6-c791-4fad-a416-21ecc1f20bbc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.722727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:15.756980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff5101-e74c-40bd-a261-0024aa50d59d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.790174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc950050-5c47-4c20-a9e9-5fc307554c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.790835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc950050-5c47-4c20-a9e9-5fc307554c91 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.791122 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc950050-5c47-4c20-a9e9-5fc307554c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.791402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc950050-5c47-4c20-a9e9-5fc307554c91 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.792163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc950050-5c47-4c20-a9e9-5fc307554c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:15.792477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc950050-5c47-4c20-a9e9-5fc307554c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.793856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095ecb6-c791-4fad-a416-21ecc1f20bbc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.793975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc950050-5c47-4c20-a9e9-5fc307554c91 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.805362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 402/811] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:15.806185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc950050-5c47-4c20-a9e9-5fc307554c91 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.827422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0145a0f-914d-4bcc-b952-8485b14d6a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.828112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0145a0f-914d-4bcc-b952-8485b14d6a93 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.828396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0145a0f-914d-4bcc-b952-8485b14d6a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.828668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0145a0f-914d-4bcc-b952-8485b14d6a93 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.829388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0145a0f-914d-4bcc-b952-8485b14d6a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:15.829695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0145a0f-914d-4bcc-b952-8485b14d6a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.831594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0145a0f-914d-4bcc-b952-8485b14d6a93 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.843620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 410/812] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:15.844440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0145a0f-914d-4bcc-b952-8485b14d6a93 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:15.860856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:15.905250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc950050-5c47-4c20-a9e9-5fc307554c91 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.933221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:15.939280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa02fc-c8ee-48b3-8c2a-431559092734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.940592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa02fc-c8ee-48b3-8c2a-431559092734 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.943475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa02fc-c8ee-48b3-8c2a-431559092734 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.943475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa02fc-c8ee-48b3-8c2a-431559092734 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.943475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa02fc-c8ee-48b3-8c2a-431559092734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:15.943475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa02fc-c8ee-48b3-8c2a-431559092734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.943945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa02fc-c8ee-48b3-8c2a-431559092734 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.944020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0145a0f-914d-4bcc-b952-8485b14d6a93 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:15.955689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 403/813] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:15.957062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ade4e4-795b-45f1-9e7e-1229877423e8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.957345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ade4e4-795b-45f1-9e7e-1229877423e8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.957997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ade4e4-795b-45f1-9e7e-1229877423e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.973688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-47ade4e4-795b-45f1-9e7e-1229877423e8 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:15.974884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-47ade4e4-795b-45f1-9e7e-1229877423e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:15.978533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f3bc4-4080-4b20-b082-9f7e65327d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:15.979197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f3bc4-4080-4b20-b082-9f7e65327d17 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:15.979479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f3bc4-4080-4b20-b082-9f7e65327d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:15.979753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f3bc4-4080-4b20-b082-9f7e65327d17 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:15.980494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f3bc4-4080-4b20-b082-9f7e65327d17 None admin] RBAC: Adding query filter params (name=network) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:15.980803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f3bc4-4080-4b20-b082-9f7e65327d17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:15.982507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f3bc4-4080-4b20-b082-9f7e65327d17 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:15.987535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 411/814] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:15.988516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f3bc4-4080-4b20-b082-9f7e65327d17 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.040577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 404/815] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:16.041250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ade4e4-795b-45f1-9e7e-1229877423e8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.086417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:16.091340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f3bc4-4080-4b20-b082-9f7e65327d17 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.125371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb62c45-cec1-4a84-afa6-e011e15711a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:16.126171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb62c45-cec1-4a84-afa6-e011e15711a8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:16.126449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb62c45-cec1-4a84-afa6-e011e15711a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:16.126720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb62c45-cec1-4a84-afa6-e011e15711a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:16.133800 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb62c45-cec1-4a84-afa6-e011e15711a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:16.135233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb62c45-cec1-4a84-afa6-e011e15711a8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:16.139975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ade4e4-795b-45f1-9e7e-1229877423e8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-beb62c45-cec1-4a84-afa6-e011e15711a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:16.149714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:16.150628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:16.151553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 412/816] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:56:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:16.152368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb62c45-cec1-4a84-afa6-e011e15711a8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.170785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:16.177004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c2390-b2bc-437c-86b1-ec53cd5d7bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:16.177796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c2390-b2bc-437c-86b1-ec53cd5d7bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:16.178077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c2390-b2bc-437c-86b1-ec53cd5d7bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:16.178349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c2390-b2bc-437c-86b1-ec53cd5d7bd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:16.185039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c2390-b2bc-437c-86b1-ec53cd5d7bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:16.186487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c2390-b2bc-437c-86b1-ec53cd5d7bd8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-853c2390-b2bc-437c-86b1-ec53cd5d7bd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:16.200190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:16.201125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:16.202244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:16.202244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:16.202244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:16.202244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:16.202244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:16.202244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:16.202244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:16.202244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:16.202244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 405/817] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:16.202881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c2390-b2bc-437c-86b1-ec53cd5d7bd8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.257148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb62c45-cec1-4a84-afa6-e011e15711a8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.290991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003a606-ae22-4ced-b370-43ead5f7bc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:16.291646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003a606-ae22-4ced-b370-43ead5f7bc05 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:16.291953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003a606-ae22-4ced-b370-43ead5f7bc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:16.292234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003a606-ae22-4ced-b370-43ead5f7bc05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:16.293066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003a606-ae22-4ced-b370-43ead5f7bc05 None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=fbfe6b7a82f746169a39976be263aa29) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:16.293379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003a606-ae22-4ced-b370-43ead5f7bc05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:16.294819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003a606-ae22-4ced-b370-43ead5f7bc05 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:16.301472 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 413/818] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:16 2022] GET /identity/v3/role_assignments?user.id=fbfe6b7a82f746169a39976be263aa29&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:16.302267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003a606-ae22-4ced-b370-43ead5f7bc05 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.317796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c2390-b2bc-437c-86b1-ec53cd5d7bd8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.320896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:16.357418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2457be2-389e-4cb0-83e8-ea8526f8e168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:16.358233 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2457be2-389e-4cb0-83e8-ea8526f8e168 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:16.358522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2457be2-389e-4cb0-83e8-ea8526f8e168 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:16.358802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2457be2-389e-4cb0-83e8-ea8526f8e168 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:16.359545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2457be2-389e-4cb0-83e8-ea8526f8e168 None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:16.359946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2457be2-389e-4cb0-83e8-ea8526f8e168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:16.361972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2457be2-389e-4cb0-83e8-ea8526f8e168 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:16.368741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 406/819] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:16.369441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2457be2-389e-4cb0-83e8-ea8526f8e168 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.415916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:16.442665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003a606-ae22-4ced-b370-43ead5f7bc05 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.487037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc98fb7-eadd-4abe-bee5-84820ee48cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:16.488040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc98fb7-eadd-4abe-bee5-84820ee48cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:16.488325 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc98fb7-eadd-4abe-bee5-84820ee48cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:16.491582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc98fb7-eadd-4abe-bee5-84820ee48cc3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:16.491582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc98fb7-eadd-4abe-bee5-84820ee48cc3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:16.491582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc98fb7-eadd-4abe-bee5-84820ee48cc3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-5bc98fb7-eadd-4abe-bee5-84820ee48cc3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:16.505765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:16.506767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 11:56:16.507601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:16.512521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 414/820] 10.222.0.49 () {56 vars in 1129 bytes} [Tue Jun 28 11:56:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:16.512823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc98fb7-eadd-4abe-bee5-84820ee48cc3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.610854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2457be2-389e-4cb0-83e8-ea8526f8e168 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.623006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc98fb7-eadd-4abe-bee5-84820ee48cc3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.646746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56527577-265c-4e23-a60c-e553e5148ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:16.647422 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56527577-265c-4e23-a60c-e553e5148ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:16.647705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56527577-265c-4e23-a60c-e553e5148ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:16.648012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56527577-265c-4e23-a60c-e553e5148ae1 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:16.648857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56527577-265c-4e23-a60c-e553e5148ae1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:16.649272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56527577-265c-4e23-a60c-e553e5148ae1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:16.650590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56527577-265c-4e23-a60c-e553e5148ae1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:16.661349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2b77d-eb0d-48b9-847c-f491d82bb29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:16.662160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2b77d-eb0d-48b9-847c-f491d82bb29b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:16.662514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2b77d-eb0d-48b9-847c-f491d82bb29b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:16.662903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2b77d-eb0d-48b9-847c-f491d82bb29b None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:16.663710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2b77d-eb0d-48b9-847c-f491d82bb29b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:16.664058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2b77d-eb0d-48b9-847c-f491d82bb29b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:16.665498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2b77d-eb0d-48b9-847c-f491d82bb29b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:16.673605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 407/821] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Jun 28 11:56:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:16.673605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56527577-265c-4e23-a60c-e553e5148ae1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.685884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 415/822] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:16.685884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2b77d-eb0d-48b9-847c-f491d82bb29b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.689345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:16.721429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:16.782822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56527577-265c-4e23-a60c-e553e5148ae1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.789540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2b77d-eb0d-48b9-847c-f491d82bb29b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.818032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be15f0-5377-4e7f-9755-e095e9e14804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:16.818698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be15f0-5377-4e7f-9755-e095e9e14804 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:16.818990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be15f0-5377-4e7f-9755-e095e9e14804 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:16.819271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be15f0-5377-4e7f-9755-e095e9e14804 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:16.820050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be15f0-5377-4e7f-9755-e095e9e14804 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:16.821426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be15f0-5377-4e7f-9755-e095e9e14804 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:16.829310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe39e03-6fd3-4875-8683-35eed534edf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:16.830974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe39e03-6fd3-4875-8683-35eed534edf6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:16.831576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe39e03-6fd3-4875-8683-35eed534edf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:16.831988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe39e03-6fd3-4875-8683-35eed534edf6 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:16.832720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe39e03-6fd3-4875-8683-35eed534edf6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:16.833039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe39e03-6fd3-4875-8683-35eed534edf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:16.834398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe39e03-6fd3-4875-8683-35eed534edf6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:16.838970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 416/823] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Jun 28 11:56:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:16.839732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe39e03-6fd3-4875-8683-35eed534edf6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.903511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:16.916139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 408/824] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Jun 28 11:56:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:16.929018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be15f0-5377-4e7f-9755-e095e9e14804 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:16.948826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe39e03-6fd3-4875-8683-35eed534edf6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:16.999594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a750-70e1-4e49-8f9f-90920a7d4dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:17.000481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a750-70e1-4e49-8f9f-90920a7d4dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:17.000822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a750-70e1-4e49-8f9f-90920a7d4dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:17.001103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a750-70e1-4e49-8f9f-90920a7d4dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:17.014445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72a750-70e1-4e49-8f9f-90920a7d4dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:17.016592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72a750-70e1-4e49-8f9f-90920a7d4dd8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-9e72a750-70e1-4e49-8f9f-90920a7d4dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:17.038131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:17.039120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:17.040051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:17.040051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:17.040051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:17.040051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:17.040051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 417/825] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:17.042679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a750-70e1-4e49-8f9f-90920a7d4dd8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:17.051083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:17.071835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be15f0-5377-4e7f-9755-e095e9e14804 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:17.120620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91433e8a-e901-4877-9f8c-9da562b60e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:17.121969 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91433e8a-e901-4877-9f8c-9da562b60e64 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:17.122262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91433e8a-e901-4877-9f8c-9da562b60e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:17.122693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91433e8a-e901-4877-9f8c-9da562b60e64 None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/66e90e70937d49c8a35928fcfc90972d/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:17.126525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91433e8a-e901-4877-9f8c-9da562b60e64 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=66e90e70937d49c8a35928fcfc90972d, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:17.128896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91433e8a-e901-4877-9f8c-9da562b60e64 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:17.178475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a750-70e1-4e49-8f9f-90920a7d4dd8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:17.194075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:17.208183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 409/826] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:56:16 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/66e90e70937d49c8a35928fcfc90972d/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:56:17.209220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91433e8a-e901-4877-9f8c-9da562b60e64 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:17.215632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bc411-8d04-4d30-b2ea-67951abd5ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:17.216410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc411-8d04-4d30-b2ea-67951abd5ecd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:17.216705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc411-8d04-4d30-b2ea-67951abd5ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:17.217353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bc411-8d04-4d30-b2ea-67951abd5ecd None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:17.217653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bc411-8d04-4d30-b2ea-67951abd5ecd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:17.217964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bc411-8d04-4d30-b2ea-67951abd5ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:17.224894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bc411-8d04-4d30-b2ea-67951abd5ecd None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:17.230545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 418/827] 10.222.0.49 () {56 vars in 1124 bytes} [Tue Jun 28 11:56:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:17.232847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bc411-8d04-4d30-b2ea-67951abd5ecd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:17.336652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91433e8a-e901-4877-9f8c-9da562b60e64 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:17.382037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bc411-8d04-4d30-b2ea-67951abd5ecd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:17.386328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f582e5-1292-441c-980a-629d2cc3bfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:17.387102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f582e5-1292-441c-980a-629d2cc3bfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:17.387483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f582e5-1292-441c-980a-629d2cc3bfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:17.387892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f582e5-1292-441c-980a-629d2cc3bfb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:17.388730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f582e5-1292-441c-980a-629d2cc3bfb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:17.389138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f582e5-1292-441c-980a-629d2cc3bfb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:17.391050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f582e5-1292-441c-980a-629d2cc3bfb0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:17.405405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 410/828] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:17.411350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f582e5-1292-441c-980a-629d2cc3bfb0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:17.415227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:17.430636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7e6b-f876-4f6a-9c36-f906e83042d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:17.431991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7e6b-f876-4f6a-9c36-f906e83042d7 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:17.432908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7e6b-f876-4f6a-9c36-f906e83042d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:17.433708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7e6b-f876-4f6a-9c36-f906e83042d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:17.434858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb7e6b-f876-4f6a-9c36-f906e83042d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:17.436910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb7e6b-f876-4f6a-9c36-f906e83042d7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:17.528621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f582e5-1292-441c-980a-629d2cc3bfb0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:17.566359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dccd9c-d916-4d81-8754-fa089cd1b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:17.567150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dccd9c-d916-4d81-8754-fa089cd1b64b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:17.567432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dccd9c-d916-4d81-8754-fa089cd1b64b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:17.567705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dccd9c-d916-4d81-8754-fa089cd1b64b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:17.574638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dccd9c-d916-4d81-8754-fa089cd1b64b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:17.576101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dccd9c-d916-4d81-8754-fa089cd1b64b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-01dccd9c-d916-4d81-8754-fa089cd1b64b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:17.590672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:17.596504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 411/829] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:17.597550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dccd9c-d916-4d81-8754-fa089cd1b64b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:17.610916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 419/830] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Jun 28 11:56:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:17.676666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:17.723682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dccd9c-d916-4d81-8754-fa089cd1b64b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:17.771058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832af882-b89b-46cd-bef6-f5d6f85ca169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:17.771058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832af882-b89b-46cd-bef6-f5d6f85ca169 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:17.771058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832af882-b89b-46cd-bef6-f5d6f85ca169 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:17.771058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832af882-b89b-46cd-bef6-f5d6f85ca169 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:17.771473 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832af882-b89b-46cd-bef6-f5d6f85ca169 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:17.771737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832af882-b89b-46cd-bef6-f5d6f85ca169 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:17.773066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832af882-b89b-46cd-bef6-f5d6f85ca169 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:17.786750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 412/831] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:17.792777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7e6b-f876-4f6a-9c36-f906e83042d7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:17.838084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:17.906663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7e6b-f876-4f6a-9c36-f906e83042d7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:17.943387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376ddfe-2e01-4f27-b4d7-ad224209f22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:17.944348 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376ddfe-2e01-4f27-b4d7-ad224209f22d None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:17.944624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376ddfe-2e01-4f27-b4d7-ad224209f22d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:17.944892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376ddfe-2e01-4f27-b4d7-ad224209f22d None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/a633011057f643218e20293412f8108f/roles/4ebdbc7b2e0b4807a0ef679e0f061a53` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:17.961815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376ddfe-2e01-4f27-b4d7-ad224209f22d None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=a633011057f643218e20293412f8108f, role_id=4ebdbc7b2e0b4807a0ef679e0f061a53)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:17.963280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376ddfe-2e01-4f27-b4d7-ad224209f22d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:18.055802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 420/832] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:56:17 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/a633011057f643218e20293412f8108f/roles/4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:56:18.543222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b6b46-25ff-4120-b225-651b2726fbb0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:18.543739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b6b46-25ff-4120-b225-651b2726fbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:18.543845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b6b46-25ff-4120-b225-651b2726fbb0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:18.545320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 413/833] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:18.551075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e6781-ad9f-47b8-9127-25c98b5aac74 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:18.551365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e6781-ad9f-47b8-9127-25c98b5aac74 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:18.551644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e6781-ad9f-47b8-9127-25c98b5aac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:18.569793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-973e6781-ad9f-47b8-9127-25c98b5aac74 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:18.571104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-973e6781-ad9f-47b8-9127-25c98b5aac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:18.642981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 421/834] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:18.664749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b6b46-25ff-4120-b225-651b2726fbb0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:18.768152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b6b46-25ff-4120-b225-651b2726fbb0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:18.786195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:18.803676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe97efd-d86f-4e21-b3a8-bae79704e341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:18.810975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe97efd-d86f-4e21-b3a8-bae79704e341 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:18.810975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe97efd-d86f-4e21-b3a8-bae79704e341 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:18.810975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe97efd-d86f-4e21-b3a8-bae79704e341 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:18.810975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe97efd-d86f-4e21-b3a8-bae79704e341 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:18.810975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe97efd-d86f-4e21-b3a8-bae79704e341 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-bbe97efd-d86f-4e21-b3a8-bae79704e341 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:18.820997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:18.821913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 11:56:18.822741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:18.825583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 414/835] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Jun 28 11:56:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:18.831861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e6781-ad9f-47b8-9127-25c98b5aac74 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:18.864735 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:18.948586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e6781-ad9f-47b8-9127-25c98b5aac74 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:18.984948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8ffd5-7d66-4f15-a8a5-72157ea31777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:18.986407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8ffd5-7d66-4f15-a8a5-72157ea31777 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:18.986924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8ffd5-7d66-4f15-a8a5-72157ea31777 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:18.987400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8ffd5-7d66-4f15-a8a5-72157ea31777 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:18.988343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8ffd5-7d66-4f15-a8a5-72157ea31777 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:18.988865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8ffd5-7d66-4f15-a8a5-72157ea31777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:18.990445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8ffd5-7d66-4f15-a8a5-72157ea31777 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:18.995847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 422/836] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:19.006392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe97efd-d86f-4e21-b3a8-bae79704e341 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:19.108097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe97efd-d86f-4e21-b3a8-bae79704e341 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:19.143609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b513-64a7-4c11-b095-596c3b7d4f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:19.144301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b513-64a7-4c11-b095-596c3b7d4f69 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:19.144588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b513-64a7-4c11-b095-596c3b7d4f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:19.144853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b513-64a7-4c11-b095-596c3b7d4f69 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:19.145558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299b513-64a7-4c11-b095-596c3b7d4f69 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:19.145862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299b513-64a7-4c11-b095-596c3b7d4f69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:19.147220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299b513-64a7-4c11-b095-596c3b7d4f69 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:19.152121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 415/837] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:19.366859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d86a6-cc76-431f-ab00-7e9837b7b167 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:19.367199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d86a6-cc76-431f-ab00-7e9837b7b167 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:19.367382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d86a6-cc76-431f-ab00-7e9837b7b167 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:19.368985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 423/838] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:19.374372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e424de6-08a4-415f-9315-5815dac916e1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:19.374666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e424de6-08a4-415f-9315-5815dac916e1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:19.374951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e424de6-08a4-415f-9315-5815dac916e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:19.392534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3e424de6-08a4-415f-9315-5815dac916e1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:19.393743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3e424de6-08a4-415f-9315-5815dac916e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:19.439165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:19.465223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 416/839] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:19.489755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d86a6-cc76-431f-ab00-7e9837b7b167 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:19.584314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:19.608518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d86a6-cc76-431f-ab00-7e9837b7b167 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:19.645483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824fbf-940d-4ac2-b9e1-d6c1644ba04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:19.646562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824fbf-940d-4ac2-b9e1-d6c1644ba04c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:19.646994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824fbf-940d-4ac2-b9e1-d6c1644ba04c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:19.647416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824fbf-940d-4ac2-b9e1-d6c1644ba04c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:19.659491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53824fbf-940d-4ac2-b9e1-d6c1644ba04c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-53824fbf-940d-4ac2-b9e1-d6c1644ba04c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:19.667440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:19.668571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:19.669618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:19.672080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 424/840] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:19.677752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e424de6-08a4-415f-9315-5815dac916e1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:19.783269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e424de6-08a4-415f-9315-5815dac916e1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:19.818236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00617a41-65d7-4bf4-a168-8b14621ade45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:19.818922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00617a41-65d7-4bf4-a168-8b14621ade45 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:19.819179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00617a41-65d7-4bf4-a168-8b14621ade45 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:19.819452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00617a41-65d7-4bf4-a168-8b14621ade45 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:19.820271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00617a41-65d7-4bf4-a168-8b14621ade45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:19.820575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00617a41-65d7-4bf4-a168-8b14621ade45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:19.821929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00617a41-65d7-4bf4-a168-8b14621ade45 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:19.831566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 417/841] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:19.836718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824fbf-940d-4ac2-b9e1-d6c1644ba04c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:19.887368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b481a-244e-4a1c-b64a-23ade08b1026 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:19.887771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b481a-244e-4a1c-b64a-23ade08b1026 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:19.888169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b481a-244e-4a1c-b64a-23ade08b1026 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:19.889851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 418/842] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:19.895780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92178f57-7a4d-4ddb-9d43-77b8a0a656a4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:19.896103 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92178f57-7a4d-4ddb-9d43-77b8a0a656a4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:19.896447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92178f57-7a4d-4ddb-9d43-77b8a0a656a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:19.915708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-92178f57-7a4d-4ddb-9d43-77b8a0a656a4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:19.917034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92178f57-7a4d-4ddb-9d43-77b8a0a656a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:19.944210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824fbf-940d-4ac2-b9e1-d6c1644ba04c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:19.956734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:19.986234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276cee9-422a-4a1b-ae0e-096eac46bbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:19.987435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276cee9-422a-4a1b-ae0e-096eac46bbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:19.987903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276cee9-422a-4a1b-ae0e-096eac46bbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:19.988291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276cee9-422a-4a1b-ae0e-096eac46bbb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:19.996132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:20.000984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276cee9-422a-4a1b-ae0e-096eac46bbb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:20.003323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 419/843] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:20.006919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276cee9-422a-4a1b-ae0e-096eac46bbb7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3276cee9-422a-4a1b-ae0e-096eac46bbb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:20.024931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:20.025922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:20.026811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:20.026811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:20.026811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:20.026811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:20.028399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92178f57-7a4d-4ddb-9d43-77b8a0a656a4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:20.029174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 425/844] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:20.035406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276cee9-422a-4a1b-ae0e-096eac46bbb7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:20.132794 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92178f57-7a4d-4ddb-9d43-77b8a0a656a4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:20.140133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276cee9-422a-4a1b-ae0e-096eac46bbb7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:20.170443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26826-9478-4f8a-a744-3821ab28b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:20.171269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26826-9478-4f8a-a744-3821ab28b6fb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.171458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26826-9478-4f8a-a744-3821ab28b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.171724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26826-9478-4f8a-a744-3821ab28b6fb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.172431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26826-9478-4f8a-a744-3821ab28b6fb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:20.173850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26826-9478-4f8a-a744-3821ab28b6fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:20.184160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646ca40-9c1a-41b3-8c94-42f7ef3d00b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:20.185079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646ca40-9c1a-41b3-8c94-42f7ef3d00b6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.185584 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646ca40-9c1a-41b3-8c94-42f7ef3d00b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.186091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646ca40-9c1a-41b3-8c94-42f7ef3d00b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-22c26826-9478-4f8a-a744-3821ab28b6fb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:20.186204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:20.187159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:20.188055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 420/845] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:56:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:20.188855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646ca40-9c1a-41b3-8c94-42f7ef3d00b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:20.189613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646ca40-9c1a-41b3-8c94-42f7ef3d00b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:20.190541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646ca40-9c1a-41b3-8c94-42f7ef3d00b6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:20.194066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26826-9478-4f8a-a744-3821ab28b6fb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:20.212240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 426/846] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:20.213491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646ca40-9c1a-41b3-8c94-42f7ef3d00b6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:20.227676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:20.307276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26826-9478-4f8a-a744-3821ab28b6fb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:20.346835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f778a4d-5b74-4112-aa0f-04b8d42cbf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:20.347533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778a4d-5b74-4112-aa0f-04b8d42cbf13 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.347817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778a4d-5b74-4112-aa0f-04b8d42cbf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.348126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778a4d-5b74-4112-aa0f-04b8d42cbf13 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.348862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f778a4d-5b74-4112-aa0f-04b8d42cbf13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:20.349171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f778a4d-5b74-4112-aa0f-04b8d42cbf13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:20.350586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f778a4d-5b74-4112-aa0f-04b8d42cbf13 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:20.357288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 421/847] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:56:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:20.357462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2d5c-a3e7-4ef7-a9c3-e35a945efe76 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.357691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2d5c-a3e7-4ef7-a9c3-e35a945efe76 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.359446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2d5c-a3e7-4ef7-a9c3-e35a945efe76 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.359446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 422/848] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:20.365332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2d5c-a3e7-4ef7-a9c3-e35a945efe76 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:20.387357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:20.442828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646ca40-9c1a-41b3-8c94-42f7ef3d00b6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:20.472556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:20.479140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce1eaa-87a5-4582-b4f3-08b515df9a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:20.479387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2d5c-a3e7-4ef7-a9c3-e35a945efe76 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:20.479976 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce1eaa-87a5-4582-b4f3-08b515df9a08 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.480264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce1eaa-87a5-4582-b4f3-08b515df9a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.480544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce1eaa-87a5-4582-b4f3-08b515df9a08 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.488737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce1eaa-87a5-4582-b4f3-08b515df9a08 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:20.490197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce1eaa-87a5-4582-b4f3-08b515df9a08 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-22ce1eaa-87a5-4582-b4f3-08b515df9a08 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:20.511932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:20.513015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 427/849] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a4d8d-fe10-4380-9ef4-c0b13fb51060 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.513932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a4d8d-fe10-4380-9ef4-c0b13fb51060 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.514629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a4d8d-fe10-4380-9ef4-c0b13fb51060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.528622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca4a4c-699f-43ab-b7f8-22779039f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:20.529477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca4a4c-699f-43ab-b7f8-22779039f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.529608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2c6a4d8d-fe10-4380-9ef4-c0b13fb51060 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:20.529763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca4a4c-699f-43ab-b7f8-22779039f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.530040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca4a4c-699f-43ab-b7f8-22779039f0d5 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.530756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca4a4c-699f-43ab-b7f8-22779039f0d5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:20.531057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2c6a4d8d-fe10-4380-9ef4-c0b13fb51060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:20.531152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca4a4c-699f-43ab-b7f8-22779039f0d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:20.532576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca4a4c-699f-43ab-b7f8-22779039f0d5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:20.547906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 423/850] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:56:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:20.547906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca4a4c-699f-43ab-b7f8-22779039f0d5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:20.610700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 428/851] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:20.635352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a4d8d-fe10-4380-9ef4-c0b13fb51060 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:20.684738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:20.710495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca4a4c-699f-43ab-b7f8-22779039f0d5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:20.742854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2de78-ec18-4a29-90bd-8d5dd4553124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:20.743938 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2de78-ec18-4a29-90bd-8d5dd4553124 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.744451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2de78-ec18-4a29-90bd-8d5dd4553124 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.744934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2de78-ec18-4a29-90bd-8d5dd4553124 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.745982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2de78-ec18-4a29-90bd-8d5dd4553124 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:20.746515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2de78-ec18-4a29-90bd-8d5dd4553124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:20.748172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2de78-ec18-4a29-90bd-8d5dd4553124 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:20.762571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a4d8d-fe10-4380-9ef4-c0b13fb51060 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:20.769036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 424/852] 10.222.0.49 () {56 vars in 1135 bytes} [Tue Jun 28 11:56:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:20.775904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2de78-ec18-4a29-90bd-8d5dd4553124 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:20.793291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:20.804801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f79868-b4c1-4856-8165-7596bf98d7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:20.812813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f79868-b4c1-4856-8165-7596bf98d7be None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.812813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f79868-b4c1-4856-8165-7596bf98d7be None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.812813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f79868-b4c1-4856-8165-7596bf98d7be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.820472 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f79868-b4c1-4856-8165-7596bf98d7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b8f79868-b4c1-4856-8165-7596bf98d7be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:20.830305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:20.831367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:56:20.832382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:20.833535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 429/853] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:56:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:20.839207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f79868-b4c1-4856-8165-7596bf98d7be None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:20.890228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2de78-ec18-4a29-90bd-8d5dd4553124 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:20.933669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400edfed-4517-4470-85c5-cc72236db8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:20.934503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400edfed-4517-4470-85c5-cc72236db8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:20.934788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400edfed-4517-4470-85c5-cc72236db8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:20.935062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400edfed-4517-4470-85c5-cc72236db8d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:20.952889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:20.956750 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f79868-b4c1-4856-8165-7596bf98d7be None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:21.000170 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f27c0-870e-48d7-bb16-7338d7efd761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:21.000785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f27c0-870e-48d7-bb16-7338d7efd761 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.001021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f27c0-870e-48d7-bb16-7338d7efd761 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.001301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f27c0-870e-48d7-bb16-7338d7efd761 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.002576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f27c0-870e-48d7-bb16-7338d7efd761 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:21.002892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f27c0-870e-48d7-bb16-7338d7efd761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.004596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f27c0-870e-48d7-bb16-7338d7efd761 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.012783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400edfed-4517-4470-85c5-cc72236db8d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.014703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400edfed-4517-4470-85c5-cc72236db8d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.015918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 430/854] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:56:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:21.023552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f27c0-870e-48d7-bb16-7338d7efd761 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:21.042409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:21.134782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 425/855] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:21.136550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400edfed-4517-4470-85c5-cc72236db8d6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:21.146909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f27c0-870e-48d7-bb16-7338d7efd761 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:21.200288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f7d0b-1ae6-479a-9f2e-67ea06d06b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:21.201347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f7d0b-1ae6-479a-9f2e-67ea06d06b45 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.201631 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f7d0b-1ae6-479a-9f2e-67ea06d06b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.201905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f7d0b-1ae6-479a-9f2e-67ea06d06b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.215955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f7d0b-1ae6-479a-9f2e-67ea06d06b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.217687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f7d0b-1ae6-479a-9f2e-67ea06d06b45 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-9f5f7d0b-1ae6-479a-9f2e-67ea06d06b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:21.239005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:21.239950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:21.240861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:21.240861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:21.240861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:21.240861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:21.247359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 431/856] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:21.248972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f7d0b-1ae6-479a-9f2e-67ea06d06b45 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:21.256861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400edfed-4517-4470-85c5-cc72236db8d6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:21.269253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:21.280997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:21.303224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df887f-63fc-4b06-ad2c-d363b5708216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:21.304172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df887f-63fc-4b06-ad2c-d363b5708216 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.304608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df887f-63fc-4b06-ad2c-d363b5708216 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.304889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df887f-63fc-4b06-ad2c-d363b5708216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.321081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df887f-63fc-4b06-ad2c-d363b5708216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.322772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df887f-63fc-4b06-ad2c-d363b5708216 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-62df887f-63fc-4b06-ad2c-d363b5708216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:21.345292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:21.346691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:21.351664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:21.351664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:21.351664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:21.351664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:21.351664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 426/857] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:21.351664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b349-3166-498e-b343-ba457668f430 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.351664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b349-3166-498e-b343-ba457668f430 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.351664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b349-3166-498e-b343-ba457668f430 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.351664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 427/858] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:21.354623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8b349-3166-498e-b343-ba457668f430 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:21.367372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f7d0b-1ae6-479a-9f2e-67ea06d06b45 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:21.404257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8997d-2fda-4cc5-9aa0-c500a0a123f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:21.404920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8997d-2fda-4cc5-9aa0-c500a0a123f9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.405220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8997d-2fda-4cc5-9aa0-c500a0a123f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.405475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8997d-2fda-4cc5-9aa0-c500a0a123f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.406222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8997d-2fda-4cc5-9aa0-c500a0a123f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:21.406502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8997d-2fda-4cc5-9aa0-c500a0a123f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.407903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8997d-2fda-4cc5-9aa0-c500a0a123f9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.420404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 432/859] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:21.425841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7056-d755-4c2f-a946-b75e86a6d217 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.426134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7056-d755-4c2f-a946-b75e86a6d217 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.426439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7056-d755-4c2f-a946-b75e86a6d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.443221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-08ad7056-d755-4c2f-a946-b75e86a6d217 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:21.444451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-08ad7056-d755-4c2f-a946-b75e86a6d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:21.465543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8b349-3166-498e-b343-ba457668f430 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:21.505762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bb3d1-79a9-4be0-bb8d-ccee8bd69b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:21.506435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bb3d1-79a9-4be0-bb8d-ccee8bd69b50 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.506725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bb3d1-79a9-4be0-bb8d-ccee8bd69b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.507057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bb3d1-79a9-4be0-bb8d-ccee8bd69b50 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.507735 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bb3d1-79a9-4be0-bb8d-ccee8bd69b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:21.508293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bb3d1-79a9-4be0-bb8d-ccee8bd69b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.509469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bb3d1-79a9-4be0-bb8d-ccee8bd69b50 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.520076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 433/860] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:21.524819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad7056-d755-4c2f-a946-b75e86a6d217 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:21.528904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:21.535925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 428/861] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:21.537501 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bb3d1-79a9-4be0-bb8d-ccee8bd69b50 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:21.569240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:21.640427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad7056-d755-4c2f-a946-b75e86a6d217 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:21.645869 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bb3d1-79a9-4be0-bb8d-ccee8bd69b50 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:21.681421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac68a3-d70b-4cef-b5fb-93532457f2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:21.682265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac68a3-d70b-4cef-b5fb-93532457f2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.682405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063864c1-de05-4583-bd5d-d92fc1de874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:21.682609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac68a3-d70b-4cef-b5fb-93532457f2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.682812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac68a3-d70b-4cef-b5fb-93532457f2e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.683198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063864c1-de05-4583-bd5d-d92fc1de874a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.683480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063864c1-de05-4583-bd5d-d92fc1de874a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.683754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063864c1-de05-4583-bd5d-d92fc1de874a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.691989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac68a3-d70b-4cef-b5fb-93532457f2e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.693087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063864c1-de05-4583-bd5d-d92fc1de874a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.693456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac68a3-d70b-4cef-b5fb-93532457f2e3 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.694555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063864c1-de05-4583-bd5d-d92fc1de874a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-68ac68a3-d70b-4cef-b5fb-93532457f2e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:21.709271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:21.710220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:21.711152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-063864c1-de05-4583-bd5d-d92fc1de874a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:21.711687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:21.712942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:21.713830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:21.713830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:21.713830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:21.713830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:21.713830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:21.713830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:21.713830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:21.713830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:21.714263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 434/862] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:56:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:21.714263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac68a3-d70b-4cef-b5fb-93532457f2e3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:21.715833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 429/863] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:21.718736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063864c1-de05-4583-bd5d-d92fc1de874a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:21.778064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:21.816890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac68a3-d70b-4cef-b5fb-93532457f2e3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:21.817292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:21.826821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063864c1-de05-4583-bd5d-d92fc1de874a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:21.854514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544a393-9d11-4475-b3e7-e9775b3b147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:21.855186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544a393-9d11-4475-b3e7-e9775b3b147e None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.855468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544a393-9d11-4475-b3e7-e9775b3b147e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.855751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544a393-9d11-4475-b3e7-e9775b3b147e None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.856507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544a393-9d11-4475-b3e7-e9775b3b147e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.857889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544a393-9d11-4475-b3e7-e9775b3b147e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.863676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66ba08-e1c3-4cbe-a686-2d91092270da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:21.864383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66ba08-e1c3-4cbe-a686-2d91092270da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:21.864669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66ba08-e1c3-4cbe-a686-2d91092270da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:21.864944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66ba08-e1c3-4cbe-a686-2d91092270da None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:21.865788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66ba08-e1c3-4cbe-a686-2d91092270da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:21.866098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66ba08-e1c3-4cbe-a686-2d91092270da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:21.867568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66ba08-e1c3-4cbe-a686-2d91092270da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:21.885364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 430/864] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Jun 28 11:56:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:21.885916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66ba08-e1c3-4cbe-a686-2d91092270da None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:21.941467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 435/865] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:56:21 2022] POST /identity/v3/services => generated 269 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:21.942829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544a393-9d11-4475-b3e7-e9775b3b147e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:22.015995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66ba08-e1c3-4cbe-a686-2d91092270da None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:22.068360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544a393-9d11-4475-b3e7-e9775b3b147e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:22.070809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e975-4dc2-4fa3-a042-76d5f145fef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:22.072822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e975-4dc2-4fa3-a042-76d5f145fef2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:22.073353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e975-4dc2-4fa3-a042-76d5f145fef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:22.073870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e975-4dc2-4fa3-a042-76d5f145fef2 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:22.074919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168e975-4dc2-4fa3-a042-76d5f145fef2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:22.075416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168e975-4dc2-4fa3-a042-76d5f145fef2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:22.077903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168e975-4dc2-4fa3-a042-76d5f145fef2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:22.092369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:22.101083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 431/866] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:22.104088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e975-4dc2-4fa3-a042-76d5f145fef2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:22.121191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e6437-ab86-4d38-b147-36bc0bc7d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:22.121191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e6437-ab86-4d38-b147-36bc0bc7d1fe None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:22.121191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e6437-ab86-4d38-b147-36bc0bc7d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:22.121191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e6437-ab86-4d38-b147-36bc0bc7d1fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:22.122169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:22.210952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e6437-ab86-4d38-b147-36bc0bc7d1fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:22.212635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e6437-ab86-4d38-b147-36bc0bc7d1fe None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:22.252094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e975-4dc2-4fa3-a042-76d5f145fef2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:22.296162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6fc05-e814-43b4-ab8f-99b727b97aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:22.296990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fc05-e814-43b4-ab8f-99b727b97aab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:22.297376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fc05-e814-43b4-ab8f-99b727b97aab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:22.297755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fc05-e814-43b4-ab8f-99b727b97aab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:22.298779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6fc05-e814-43b4-ab8f-99b727b97aab None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=66e90e70937d49c8a35928fcfc90972d) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:22.299686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6fc05-e814-43b4-ab8f-99b727b97aab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:22.301355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6fc05-e814-43b4-ab8f-99b727b97aab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:22.307910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 432/867] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:22 2022] GET /identity/v3/role_assignments?user.id=66e90e70937d49c8a35928fcfc90972d&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:22.333740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 436/868] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:21 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:22.340169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6fc05-e814-43b4-ab8f-99b727b97aab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:22.419899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:22.452402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6fc05-e814-43b4-ab8f-99b727b97aab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:22.490483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721fed1-2817-415a-877a-7e55da483ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:22.491282 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721fed1-2817-415a-877a-7e55da483ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:22.491563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721fed1-2817-415a-877a-7e55da483ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:22.491833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721fed1-2817-415a-877a-7e55da483ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:22.503948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721fed1-2817-415a-877a-7e55da483ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:22.505411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721fed1-2817-415a-877a-7e55da483ce4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3721fed1-2817-415a-877a-7e55da483ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:22.523630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:22.524778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:22.526021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:22.526021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:22.526021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:22.526021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:22.526021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 433/869] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:22.531173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e6437-ab86-4d38-b147-36bc0bc7d1fe None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:22.555688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:22.637209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e6437-ab86-4d38-b147-36bc0bc7d1fe None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:22.638958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0f0cf-06c0-429d-bead-50649e3654a6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:22.639247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0f0cf-06c0-429d-bead-50649e3654a6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:22.639525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0f0cf-06c0-429d-bead-50649e3654a6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:22.641159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 434/870] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:22.646098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b4197-7b4d-4c6b-8b57-e3146193afec None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:22.646382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b4197-7b4d-4c6b-8b57-e3146193afec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:22.646658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b4197-7b4d-4c6b-8b57-e3146193afec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:22.663845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2c3b4197-7b4d-4c6b-8b57-e3146193afec None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:22.665121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c3b4197-7b4d-4c6b-8b57-e3146193afec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:22.679502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532a735-278b-40f1-bb30-01747d5b7719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:22.680846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532a735-278b-40f1-bb30-01747d5b7719 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:22.681554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532a735-278b-40f1-bb30-01747d5b7719 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:22.681981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532a735-278b-40f1-bb30-01747d5b7719 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:22.683017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532a735-278b-40f1-bb30-01747d5b7719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:22.683771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532a735-278b-40f1-bb30-01747d5b7719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:22.685312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532a735-278b-40f1-bb30-01747d5b7719 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:22.707412 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 437/871] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:22.709395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532a735-278b-40f1-bb30-01747d5b7719 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:22.738995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 435/872] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:22 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:22.762484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b4197-7b4d-4c6b-8b57-e3146193afec None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:22.816091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:22.820447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:22.841862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532a735-278b-40f1-bb30-01747d5b7719 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:22.873474 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b4197-7b4d-4c6b-8b57-e3146193afec None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:22.883518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7406725-ceea-4f1d-90de-85614ed230b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:22.884694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7406725-ceea-4f1d-90de-85614ed230b1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:22.885182 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7406725-ceea-4f1d-90de-85614ed230b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:22.885985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7406725-ceea-4f1d-90de-85614ed230b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:22.895324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7406725-ceea-4f1d-90de-85614ed230b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:22.897015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7406725-ceea-4f1d-90de-85614ed230b1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:22.912277 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a1e9b-d49e-495a-9646-ad7ee1985f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:22.913044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a1e9b-d49e-495a-9646-ad7ee1985f64 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:22.913395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a1e9b-d49e-495a-9646-ad7ee1985f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:22.913738 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a1e9b-d49e-495a-9646-ad7ee1985f64 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:22.914538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a1e9b-d49e-495a-9646-ad7ee1985f64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:22.916005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a1e9b-d49e-495a-9646-ad7ee1985f64 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f7406725-ceea-4f1d-90de-85614ed230b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:22.916956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:22.917801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:22.918695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:22.918695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:22.918695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:22.918695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:22.918695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:22.918695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:22.918695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:22.918695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:22.926306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 438/873] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:22.927788 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7406725-ceea-4f1d-90de-85614ed230b1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:23.032430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 436/874] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:56:22 2022] POST /identity/v3/services => generated 251 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:23.034594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7406725-ceea-4f1d-90de-85614ed230b1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:23.081553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd296e7-c211-4af9-90b7-39205c3fc299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:23.082392 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd296e7-c211-4af9-90b7-39205c3fc299 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:23.082586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd296e7-c211-4af9-90b7-39205c3fc299 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:23.082865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd296e7-c211-4af9-90b7-39205c3fc299 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:23.083669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd296e7-c211-4af9-90b7-39205c3fc299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:23.084018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd296e7-c211-4af9-90b7-39205c3fc299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:23.085561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd296e7-c211-4af9-90b7-39205c3fc299 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:23.088797 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:23.104034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 439/875] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:23.106718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a1e9b-d49e-495a-9646-ad7ee1985f64 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:23.230503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a1e9b-d49e-495a-9646-ad7ee1985f64 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:23.246727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:23.268511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f127a-6478-45f9-a44b-cdfd922cda44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:23.269176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f127a-6478-45f9-a44b-cdfd922cda44 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:23.269458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f127a-6478-45f9-a44b-cdfd922cda44 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:23.269728 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f127a-6478-45f9-a44b-cdfd922cda44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:23.270573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f127a-6478-45f9-a44b-cdfd922cda44 None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=a633011057f643218e20293412f8108f) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:23.270881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f127a-6478-45f9-a44b-cdfd922cda44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:23.272459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f127a-6478-45f9-a44b-cdfd922cda44 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:23.287311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 437/876] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:23 2022] GET /identity/v3/role_assignments?user.id=a633011057f643218e20293412f8108f&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:24.110421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e5fa-39c4-4556-adda-0ba1b0635491 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:24.110937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e5fa-39c4-4556-adda-0ba1b0635491 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:24.111039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65e5fa-39c4-4556-adda-0ba1b0635491 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:24.113498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 440/877] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:24.118633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b69f-7657-4f56-9d71-c2dc154b010b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:24.119036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b69f-7657-4f56-9d71-c2dc154b010b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:24.119226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b69f-7657-4f56-9d71-c2dc154b010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:24.136909 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7613b69f-7657-4f56-9d71-c2dc154b010b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:24.138098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7613b69f-7657-4f56-9d71-c2dc154b010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:24.207967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 438/878] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:24.231332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65e5fa-39c4-4556-adda-0ba1b0635491 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:24.335460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65e5fa-39c4-4556-adda-0ba1b0635491 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:24.369623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35446-8434-4873-a5e8-e4515df97e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:24.370684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35446-8434-4873-a5e8-e4515df97e5c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:24.370974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35446-8434-4873-a5e8-e4515df97e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:24.371249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35446-8434-4873-a5e8-e4515df97e5c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:24.371927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a35446-8434-4873-a5e8-e4515df97e5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:24.373302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a35446-8434-4873-a5e8-e4515df97e5c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-d8a35446-8434-4873-a5e8-e4515df97e5c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:24.388052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:24.389020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:24.389848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 441/879] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Jun 28 11:56:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:24.395796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613b69f-7657-4f56-9d71-c2dc154b010b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:24.498910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613b69f-7657-4f56-9d71-c2dc154b010b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:24.516264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:24.538991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a121a-c1f8-44a2-80c2-52634612fdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:24.539664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a121a-c1f8-44a2-80c2-52634612fdad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:24.539975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a121a-c1f8-44a2-80c2-52634612fdad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:24.540259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a121a-c1f8-44a2-80c2-52634612fdad None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:24.540977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a121a-c1f8-44a2-80c2-52634612fdad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:24.541287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a121a-c1f8-44a2-80c2-52634612fdad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:24.542731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a121a-c1f8-44a2-80c2-52634612fdad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:24.548090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 439/880] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:24.554482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35446-8434-4873-a5e8-e4515df97e5c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:24.573390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ced1f5-b096-4b2b-8338-cf1fa6e39ffe None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:24.573709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ced1f5-b096-4b2b-8338-cf1fa6e39ffe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:24.573953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ced1f5-b096-4b2b-8338-cf1fa6e39ffe None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:24.575436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 440/881] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:24.581170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcd825-faad-4586-8f2b-c893fcdfa458 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:24.581675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcd825-faad-4586-8f2b-c893fcdfa458 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:24.582163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcd825-faad-4586-8f2b-c893fcdfa458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:24.600099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1dbcd825-faad-4586-8f2b-c893fcdfa458 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:24.601856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1dbcd825-faad-4586-8f2b-c893fcdfa458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:24.636347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:24.673796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35446-8434-4873-a5e8-e4515df97e5c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:24.683920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 441/882] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:24.702083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcd825-faad-4586-8f2b-c893fcdfa458 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:24.712997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26f5f-010f-4178-9eca-3a7b353c7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:24.714132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26f5f-010f-4178-9eca-3a7b353c7499 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:24.714631 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26f5f-010f-4178-9eca-3a7b353c7499 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:24.715135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26f5f-010f-4178-9eca-3a7b353c7499 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:24.716097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f26f5f-010f-4178-9eca-3a7b353c7499 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:24.716706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f26f5f-010f-4178-9eca-3a7b353c7499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:24.718397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f26f5f-010f-4178-9eca-3a7b353c7499 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:24.725364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 442/883] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:24.730868 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26f5f-010f-4178-9eca-3a7b353c7499 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:24.808383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcd825-faad-4586-8f2b-c893fcdfa458 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:24.810409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:24.849723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b2ae0-498d-4392-9376-1bdba9a3cbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:24.851202 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b2ae0-498d-4392-9376-1bdba9a3cbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:24.851681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b2ae0-498d-4392-9376-1bdba9a3cbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:24.852200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b2ae0-498d-4392-9376-1bdba9a3cbb1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:24.853002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26f5f-010f-4178-9eca-3a7b353c7499 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:24.853256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b2ae0-498d-4392-9376-1bdba9a3cbb1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:24.854799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b2ae0-498d-4392-9376-1bdba9a3cbb1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-846b2ae0-498d-4392-9376-1bdba9a3cbb1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:24.868215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:24.869250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:24.870081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:24.872934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 442/884] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:24.883950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b2ae0-498d-4392-9376-1bdba9a3cbb1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:24.884558 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:24.893028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42492991-b599-4960-8453-49af4fae3176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:24.893028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492991-b599-4960-8453-49af4fae3176 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:24.893028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492991-b599-4960-8453-49af4fae3176 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:24.893337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492991-b599-4960-8453-49af4fae3176 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:24.894546 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42492991-b599-4960-8453-49af4fae3176 None admin] RBAC: Adding query filter params (interface=public, service_id=15d8269949504ed39a50792947ac8c3e, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:24.894864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42492991-b599-4960-8453-49af4fae3176 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:24.896963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42492991-b599-4960-8453-49af4fae3176 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:24.907971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 443/885] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Jun 28 11:56:24 2022] GET /identity/v3/endpoints?service_id=15d8269949504ed39a50792947ac8c3e&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:24.909793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42492991-b599-4960-8453-49af4fae3176 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:25.004602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b2ae0-498d-4392-9376-1bdba9a3cbb1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:25.045586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e3cc7-6ac1-41a0-afb5-1bdaa102a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:25.046261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3cc7-6ac1-41a0-afb5-1bdaa102a5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.046549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3cc7-6ac1-41a0-afb5-1bdaa102a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.046891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3cc7-6ac1-41a0-afb5-1bdaa102a5b7 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.047609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e3cc7-6ac1-41a0-afb5-1bdaa102a5b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:25.047999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e3cc7-6ac1-41a0-afb5-1bdaa102a5b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:25.049260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42492991-b599-4960-8453-49af4fae3176 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:25.049918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e3cc7-6ac1-41a0-afb5-1bdaa102a5b7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:25.057873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 443/886] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:25.064415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e3cc7-6ac1-41a0-afb5-1bdaa102a5b7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:25.092251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a7d8d-f54f-4373-82a1-4904e1670838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:25.092984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7d8d-f54f-4373-82a1-4904e1670838 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.093271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7d8d-f54f-4373-82a1-4904e1670838 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.093552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a7d8d-f54f-4373-82a1-4904e1670838 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.094611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a7d8d-f54f-4373-82a1-4904e1670838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:25.096212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a7d8d-f54f-4373-82a1-4904e1670838 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:25.105119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:25.108297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 444/887] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Jun 28 11:56:24 2022] GET /identity/v3/services => generated 1268 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 11:56:25.187320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e3cc7-6ac1-41a0-afb5-1bdaa102a5b7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:25.196776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d3575-800c-4484-a995-75537b0212bb None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.197333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d3575-800c-4484-a995-75537b0212bb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.197333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d3575-800c-4484-a995-75537b0212bb None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.199099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 445/888] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:25.205499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f524ae-a933-4347-b01e-4e03beeec165 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.205796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f524ae-a933-4347-b01e-4e03beeec165 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.206060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f524ae-a933-4347-b01e-4e03beeec165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.224673 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-09f524ae-a933-4347-b01e-4e03beeec165 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:25.226033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-09f524ae-a933-4347-b01e-4e03beeec165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:25.235124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961fb8a-2914-468d-b04e-a8481cb63851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:25.236238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961fb8a-2914-468d-b04e-a8481cb63851 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.237140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961fb8a-2914-468d-b04e-a8481cb63851 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.237606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961fb8a-2914-468d-b04e-a8481cb63851 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.238861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961fb8a-2914-468d-b04e-a8481cb63851 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:25.239640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961fb8a-2914-468d-b04e-a8481cb63851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:25.241521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961fb8a-2914-468d-b04e-a8481cb63851 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:25.248817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 444/889] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:25.299749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:25.314877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 446/890] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:25.338491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961fb8a-2914-468d-b04e-a8481cb63851 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:25.447310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:25.454058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961fb8a-2914-468d-b04e-a8481cb63851 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:25.491272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e66b9-8266-4067-9b51-b0c7326bedd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:25.492113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e66b9-8266-4067-9b51-b0c7326bedd9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.492409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e66b9-8266-4067-9b51-b0c7326bedd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.492695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e66b9-8266-4067-9b51-b0c7326bedd9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.493365 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e66b9-8266-4067-9b51-b0c7326bedd9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:25.494811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e66b9-8266-4067-9b51-b0c7326bedd9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1d7e66b9-8266-4067-9b51-b0c7326bedd9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:25.513523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:25.514556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:25.515375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 445/891] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:56:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:25.529023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f524ae-a933-4347-b01e-4e03beeec165 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:25.553160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84b4ef-3e45-489e-bf32-8e1a0806fb11 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.553468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84b4ef-3e45-489e-bf32-8e1a0806fb11 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.553726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84b4ef-3e45-489e-bf32-8e1a0806fb11 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.555347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 446/892] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:25.560270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2010af-ef48-41a1-8cec-3ae28480f91e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.560558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2010af-ef48-41a1-8cec-3ae28480f91e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.560837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2010af-ef48-41a1-8cec-3ae28480f91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.578287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9b2010af-ef48-41a1-8cec-3ae28480f91e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:25.579582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b2010af-ef48-41a1-8cec-3ae28480f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:25.653688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 447/893] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:25.654688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f524ae-a933-4347-b01e-4e03beeec165 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:25.678632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2010af-ef48-41a1-8cec-3ae28480f91e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:25.692497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4006b37-1248-44f3-a8a1-99c2ecd63b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:25.693337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4006b37-1248-44f3-a8a1-99c2ecd63b8b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.693624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4006b37-1248-44f3-a8a1-99c2ecd63b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.694276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4006b37-1248-44f3-a8a1-99c2ecd63b8b None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.695281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4006b37-1248-44f3-a8a1-99c2ecd63b8b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:25.695600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4006b37-1248-44f3-a8a1-99c2ecd63b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:25.697187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4006b37-1248-44f3-a8a1-99c2ecd63b8b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:25.703951 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 447/894] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:56:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:25.709918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4006b37-1248-44f3-a8a1-99c2ecd63b8b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:25.771833 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:25.777579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:25.793318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2010af-ef48-41a1-8cec-3ae28480f91e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:25.838840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4006b37-1248-44f3-a8a1-99c2ecd63b8b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:25.843226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386597-155a-4010-862f-56dd2b29eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:25.844314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386597-155a-4010-862f-56dd2b29eb9d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.844828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386597-155a-4010-862f-56dd2b29eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.845343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386597-155a-4010-862f-56dd2b29eb9d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.860143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75386597-155a-4010-862f-56dd2b29eb9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-75386597-155a-4010-862f-56dd2b29eb9d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:25.872754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:25.873686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:25.874518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:25.875142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf51d9-e462-4ba0-842a-793c6c5300d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:25.876414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf51d9-e462-4ba0-842a-793c6c5300d9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:25.877281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf51d9-e462-4ba0-842a-793c6c5300d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:25.877563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf51d9-e462-4ba0-842a-793c6c5300d9 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:25.878466 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf51d9-e462-4ba0-842a-793c6c5300d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:25.878856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf51d9-e462-4ba0-842a-793c6c5300d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:25.879068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 448/895] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Jun 28 11:56:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:25.884137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf51d9-e462-4ba0-842a-793c6c5300d9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:25.884283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386597-155a-4010-862f-56dd2b29eb9d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:25.893864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 448/896] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:56:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:25.895025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf51d9-e462-4ba0-842a-793c6c5300d9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:25.991861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386597-155a-4010-862f-56dd2b29eb9d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:26.006179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf51d9-e462-4ba0-842a-793c6c5300d9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:26.018098 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:26.026704 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3017b-6fc1-4633-9546-3fb9396cb386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:26.027565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3017b-6fc1-4633-9546-3fb9396cb386 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:26.027973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3017b-6fc1-4633-9546-3fb9396cb386 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:26.028348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3017b-6fc1-4633-9546-3fb9396cb386 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:26.029198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3017b-6fc1-4633-9546-3fb9396cb386 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:26.029777 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3017b-6fc1-4633-9546-3fb9396cb386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:26.031089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3017b-6fc1-4633-9546-3fb9396cb386 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:26.044029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 449/897] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Jun 28 11:56:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:26.045747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3017b-6fc1-4633-9546-3fb9396cb386 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:26.049971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38835eb-81d7-42b0-8702-df9599d84bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:26.050682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38835eb-81d7-42b0-8702-df9599d84bdc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:26.051790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38835eb-81d7-42b0-8702-df9599d84bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:26.051790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38835eb-81d7-42b0-8702-df9599d84bdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:26.052203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38835eb-81d7-42b0-8702-df9599d84bdc None admin] RBAC: Adding query filter params (interface=public, service_id=1af33e0788934840a7825b4ed6a47fa4, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:26.052512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38835eb-81d7-42b0-8702-df9599d84bdc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:26.053877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38835eb-81d7-42b0-8702-df9599d84bdc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:26.064103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 449/898] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Jun 28 11:56:25 2022] GET /identity/v3/endpoints?service_id=1af33e0788934840a7825b4ed6a47fa4&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:26.065182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:26.066478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38835eb-81d7-42b0-8702-df9599d84bdc None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:26.152175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3017b-6fc1-4633-9546-3fb9396cb386 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:26.170884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38835eb-81d7-42b0-8702-df9599d84bdc None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:26.187081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48949049-1e2e-4cfd-b711-377cb87ae93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:26.187896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48949049-1e2e-4cfd-b711-377cb87ae93d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:26.188451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48949049-1e2e-4cfd-b711-377cb87ae93d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:26.188451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48949049-1e2e-4cfd-b711-377cb87ae93d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:26.198948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48949049-1e2e-4cfd-b711-377cb87ae93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:26.200496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48949049-1e2e-4cfd-b711-377cb87ae93d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:26.208723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228b365-60dc-4f21-a3ae-d371b490f310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:26.209957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228b365-60dc-4f21-a3ae-d371b490f310 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:26.210530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228b365-60dc-4f21-a3ae-d371b490f310 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:26.210999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228b365-60dc-4f21-a3ae-d371b490f310 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:26.211910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228b365-60dc-4f21-a3ae-d371b490f310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:26.213461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228b365-60dc-4f21-a3ae-d371b490f310 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-48949049-1e2e-4cfd-b711-377cb87ae93d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:26.227915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:26.229056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:26.230229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:26.230229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:26.230229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:26.230229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:26.230229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 450/899] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:26.230572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 450/900] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Jun 28 11:56:26 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 11:56:26.236915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48949049-1e2e-4cfd-b711-377cb87ae93d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:26.315375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:26.354212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48949049-1e2e-4cfd-b711-377cb87ae93d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:26.395088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda0df9-c532-41c9-98bd-23bf47959f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:26.395772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda0df9-c532-41c9-98bd-23bf47959f21 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:26.396090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda0df9-c532-41c9-98bd-23bf47959f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:26.396367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda0df9-c532-41c9-98bd-23bf47959f21 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:26.397121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda0df9-c532-41c9-98bd-23bf47959f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:26.397422 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda0df9-c532-41c9-98bd-23bf47959f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:26.398786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda0df9-c532-41c9-98bd-23bf47959f21 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:26.411592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 451/901] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:26.417866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228b365-60dc-4f21-a3ae-d371b490f310 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:26.464298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:26.526931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228b365-60dc-4f21-a3ae-d371b490f310 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:26.563109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61909ca-dfa1-4e9d-8d9a-9e8c8e0f9e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:26.563939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61909ca-dfa1-4e9d-8d9a-9e8c8e0f9e0f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:26.564337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61909ca-dfa1-4e9d-8d9a-9e8c8e0f9e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:26.564692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61909ca-dfa1-4e9d-8d9a-9e8c8e0f9e0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:26.572177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61909ca-dfa1-4e9d-8d9a-9e8c8e0f9e0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:26.573553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61909ca-dfa1-4e9d-8d9a-9e8c8e0f9e0f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a61909ca-dfa1-4e9d-8d9a-9e8c8e0f9e0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:26.588327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:26.589243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:26.590166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 451/902] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:56:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:26.595979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda0df9-c532-41c9-98bd-23bf47959f21 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:26.709518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda0df9-c532-41c9-98bd-23bf47959f21 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:26.732718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:26.745232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e694-fbf1-4818-9c8c-2e2fd47b2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:26.745903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e694-fbf1-4818-9c8c-2e2fd47b2eec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:26.746185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e694-fbf1-4818-9c8c-2e2fd47b2eec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:26.746457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e694-fbf1-4818-9c8c-2e2fd47b2eec None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:26.747301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249e694-fbf1-4818-9c8c-2e2fd47b2eec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:26.747607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249e694-fbf1-4818-9c8c-2e2fd47b2eec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:26.749066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249e694-fbf1-4818-9c8c-2e2fd47b2eec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:26.770075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 452/903] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Jun 28 11:56:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:26.775682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61909ca-dfa1-4e9d-8d9a-9e8c8e0f9e0f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:26.878695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:26.883081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61909ca-dfa1-4e9d-8d9a-9e8c8e0f9e0f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:26.918159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ac49f-9bf7-467d-b26a-b277b48dbcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:26.918811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ac49f-9bf7-467d-b26a-b277b48dbcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:26.919088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ac49f-9bf7-467d-b26a-b277b48dbcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:26.919359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ac49f-9bf7-467d-b26a-b277b48dbcf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:26.991065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ac49f-9bf7-467d-b26a-b277b48dbcf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:26.992567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ac49f-9bf7-467d-b26a-b277b48dbcf9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:27.089469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:27.094217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 452/904] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:26 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:27.104593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e694-fbf1-4818-9c8c-2e2fd47b2eec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:27.207662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e694-fbf1-4818-9c8c-2e2fd47b2eec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:27.243190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2cb0d-d06c-4cda-81cf-d0e949c8c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:27.244361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2cb0d-d06c-4cda-81cf-d0e949c8c588 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.244874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2cb0d-d06c-4cda-81cf-d0e949c8c588 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.245363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2cb0d-d06c-4cda-81cf-d0e949c8c588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.256253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2cb0d-d06c-4cda-81cf-d0e949c8c588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:27.257956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2cb0d-d06c-4cda-81cf-d0e949c8c588 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a7b2cb0d-d06c-4cda-81cf-d0e949c8c588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:27.275972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:27.276979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:27.277984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:27.277984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:27.277984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:27.277984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:27.280273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 453/905] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:27.286697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ac49f-9bf7-467d-b26a-b277b48dbcf9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:27.317470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713c45f-0244-40b4-a70d-31fd101a8444 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.317802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713c45f-0244-40b4-a70d-31fd101a8444 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.318059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713c45f-0244-40b4-a70d-31fd101a8444 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.319788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 454/906] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:27.321044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd44f60-cb43-4fcd-be9a-5a6568338f40 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.321322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd44f60-cb43-4fcd-be9a-5a6568338f40 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.321595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd44f60-cb43-4fcd-be9a-5a6568338f40 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.323616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 455/907] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:27.325313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f0b9a-e47e-4451-95c7-e9798e52de71 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.325596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f0b9a-e47e-4451-95c7-e9798e52de71 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.325869 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f0b9a-e47e-4451-95c7-e9798e52de71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.347368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d52f0b9a-e47e-4451-95c7-e9798e52de71 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:27.349105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d52f0b9a-e47e-4451-95c7-e9798e52de71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:27.382414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:27.395393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ac49f-9bf7-467d-b26a-b277b48dbcf9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:27.428729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898722a-df4e-41a2-98b2-d2c15dc17370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:27.429393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898722a-df4e-41a2-98b2-d2c15dc17370 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.429680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898722a-df4e-41a2-98b2-d2c15dc17370 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.429960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898722a-df4e-41a2-98b2-d2c15dc17370 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.430682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898722a-df4e-41a2-98b2-d2c15dc17370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:27.430992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898722a-df4e-41a2-98b2-d2c15dc17370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:27.432579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898722a-df4e-41a2-98b2-d2c15dc17370 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:27.434141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 456/908] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:27.435434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015d91-eea1-46ce-bfc2-050e5b5355e1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.435747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015d91-eea1-46ce-bfc2-050e5b5355e1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.436027 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e015d91-eea1-46ce-bfc2-050e5b5355e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.454629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 453/909] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:27.456611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898722a-df4e-41a2-98b2-d2c15dc17370 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:27.459388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8e015d91-eea1-46ce-bfc2-050e5b5355e1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:27.460942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e015d91-eea1-46ce-bfc2-050e5b5355e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:27.523273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:27.538189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 457/910] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:27.542516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015d91-eea1-46ce-bfc2-050e5b5355e1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:27.574956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898722a-df4e-41a2-98b2-d2c15dc17370 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:27.614495 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe5ac6-4f91-4cdf-bfee-fe133da9d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:27.615306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe5ac6-4f91-4cdf-bfee-fe133da9d58f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.615590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe5ac6-4f91-4cdf-bfee-fe133da9d58f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.615856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe5ac6-4f91-4cdf-bfee-fe133da9d58f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.616536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe5ac6-4f91-4cdf-bfee-fe133da9d58f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:27.617906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe5ac6-4f91-4cdf-bfee-fe133da9d58f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f9fe5ac6-4f91-4cdf-bfee-fe133da9d58f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:27.632244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:27.633262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 11:56:27.634126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:27.636010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 454/911] 10.222.0.49 () {56 vars in 1132 bytes} [Tue Jun 28 11:56:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:27.637375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe5ac6-4f91-4cdf-bfee-fe133da9d58f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:27.645227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:27.653661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e015d91-eea1-46ce-bfc2-050e5b5355e1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:27.695183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e9ca9-1e4c-4f06-b328-c00085e62c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:27.696799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e9ca9-1e4c-4f06-b328-c00085e62c18 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.697358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e9ca9-1e4c-4f06-b328-c00085e62c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.697791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e9ca9-1e4c-4f06-b328-c00085e62c18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.705741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e9ca9-1e4c-4f06-b328-c00085e62c18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:27.707175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e9ca9-1e4c-4f06-b328-c00085e62c18 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f77e9ca9-1e4c-4f06-b328-c00085e62c18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:27.721395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:27.722486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 458/912] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:27.723377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e9ca9-1e4c-4f06-b328-c00085e62c18 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:27.749918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe5ac6-4f91-4cdf-bfee-fe133da9d58f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:27.772426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:27.784536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00be2d-dd63-4502-a67f-2b6a47e5a186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:27.785279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00be2d-dd63-4502-a67f-2b6a47e5a186 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.785564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00be2d-dd63-4502-a67f-2b6a47e5a186 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.785840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00be2d-dd63-4502-a67f-2b6a47e5a186 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.786566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00be2d-dd63-4502-a67f-2b6a47e5a186 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:27.787957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00be2d-dd63-4502-a67f-2b6a47e5a186 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:27.833761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e9ca9-1e4c-4f06-b328-c00085e62c18 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:27.863550 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 455/913] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:56:27 2022] POST /identity/v3/services => generated 241 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:27.864643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00be2d-dd63-4502-a67f-2b6a47e5a186 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:27.884978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99c9fe-a46b-4224-b6c8-e93a2ce43648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:27.885865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99c9fe-a46b-4224-b6c8-e93a2ce43648 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:27.886243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99c9fe-a46b-4224-b6c8-e93a2ce43648 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:27.886663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99c9fe-a46b-4224-b6c8-e93a2ce43648 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:27.887502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99c9fe-a46b-4224-b6c8-e93a2ce43648 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:27.887988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99c9fe-a46b-4224-b6c8-e93a2ce43648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:27.889871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99c9fe-a46b-4224-b6c8-e93a2ce43648 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:27.901054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 459/914] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:27.902550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99c9fe-a46b-4224-b6c8-e93a2ce43648 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:27.921093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:28.018950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99c9fe-a46b-4224-b6c8-e93a2ce43648 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:28.021298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00be2d-dd63-4502-a67f-2b6a47e5a186 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:28.061551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696da38-b54a-445c-b78b-a2d3f416c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:28.062568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696da38-b54a-445c-b78b-a2d3f416c297 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:28.062854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696da38-b54a-445c-b78b-a2d3f416c297 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:28.063133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696da38-b54a-445c-b78b-a2d3f416c297 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:28.063849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696da38-b54a-445c-b78b-a2d3f416c297 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:28.064210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696da38-b54a-445c-b78b-a2d3f416c297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:28.065627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696da38-b54a-445c-b78b-a2d3f416c297 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:28.070911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 460/915] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:28.072096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef924d2-917d-477e-8e9d-d1ae1761e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:28.072945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef924d2-917d-477e-8e9d-d1ae1761e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:28.073229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef924d2-917d-477e-8e9d-d1ae1761e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:28.073500 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef924d2-917d-477e-8e9d-d1ae1761e7b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:28.074292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef924d2-917d-477e-8e9d-d1ae1761e7b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:28.074600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef924d2-917d-477e-8e9d-d1ae1761e7b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:28.076666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef924d2-917d-477e-8e9d-d1ae1761e7b9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:28.077157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696da38-b54a-445c-b78b-a2d3f416c297 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:28.090470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 456/916] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:28.097619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef924d2-917d-477e-8e9d-d1ae1761e7b9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:28.153351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:28.179808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:28.214999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696da38-b54a-445c-b78b-a2d3f416c297 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:28.215637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef924d2-917d-477e-8e9d-d1ae1761e7b9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:28.255572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dc57b-c089-4bf9-9d85-25034e257572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:28.256472 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc57b-c089-4bf9-9d85-25034e257572 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:28.256605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc57b-c089-4bf9-9d85-25034e257572 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:28.256787 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc57b-c089-4bf9-9d85-25034e257572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:28.257638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dc57b-c089-4bf9-9d85-25034e257572 None admin] RBAC: Adding query filter params (role.id=0c79e2ac1c3248618dfc1b9f7374a15a, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=a633011057f643218e20293412f8108f) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:28.257927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dc57b-c089-4bf9-9d85-25034e257572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:28.259437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dc57b-c089-4bf9-9d85-25034e257572 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:28.268611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5f123-bb0e-4511-aafa-963b96d7e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:28.269875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f123-bb0e-4511-aafa-963b96d7e645 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:28.270361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f123-bb0e-4511-aafa-963b96d7e645 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:28.270900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f123-bb0e-4511-aafa-963b96d7e645 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:28.271895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5f123-bb0e-4511-aafa-963b96d7e645 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:28.272020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 457/917] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:28 2022] GET /identity/v3/role_assignments?user.id=a633011057f643218e20293412f8108f&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=0c79e2ac1c3248618dfc1b9f7374a15a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:28.273626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5f123-bb0e-4511-aafa-963b96d7e645 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:28.346435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 461/918] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Jun 28 11:56:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 11:56:28.528214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df88f7f-58c3-46b7-860b-28ca1877621d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:28.528681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df88f7f-58c3-46b7-860b-28ca1877621d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:28.528776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df88f7f-58c3-46b7-860b-28ca1877621d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:28.530287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 458/919] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:28.537118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44084d0-2fe3-48e8-858b-d0bbfd046a5f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:28.537703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44084d0-2fe3-48e8-858b-d0bbfd046a5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:28.538224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44084d0-2fe3-48e8-858b-d0bbfd046a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:28.556419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e44084d0-2fe3-48e8-858b-d0bbfd046a5f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:28.557940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e44084d0-2fe3-48e8-858b-d0bbfd046a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:28.640198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 462/920] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:28.661519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df88f7f-58c3-46b7-860b-28ca1877621d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:28.775825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df88f7f-58c3-46b7-860b-28ca1877621d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:28.784590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:28.812515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ea63-1285-4691-b886-c964c8b07a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:28.813322 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ea63-1285-4691-b886-c964c8b07a8d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:28.813606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ea63-1285-4691-b886-c964c8b07a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:28.813879 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ea63-1285-4691-b886-c964c8b07a8d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:28.815155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ea63-1285-4691-b886-c964c8b07a8d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:28.816630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6ea63-1285-4691-b886-c964c8b07a8d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8bb6ea63-1285-4691-b886-c964c8b07a8d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:28.828540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:28.829615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:28.831385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 459/921] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:56:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:28.838623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44084d0-2fe3-48e8-858b-d0bbfd046a5f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:28.899621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:28.945741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44084d0-2fe3-48e8-858b-d0bbfd046a5f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:28.982550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a59a71-2686-4fe8-8aac-efcd5ede85dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:28.983230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a59a71-2686-4fe8-8aac-efcd5ede85dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:28.983513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a59a71-2686-4fe8-8aac-efcd5ede85dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:28.983787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a59a71-2686-4fe8-8aac-efcd5ede85dc None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:28.984530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a59a71-2686-4fe8-8aac-efcd5ede85dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:28.984837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a59a71-2686-4fe8-8aac-efcd5ede85dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:28.987059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a59a71-2686-4fe8-8aac-efcd5ede85dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:28.992033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 463/922] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:56:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:29.000906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ea63-1285-4691-b886-c964c8b07a8d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:29.113843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6ea63-1285-4691-b886-c964c8b07a8d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:29.150146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9e4bd-7bd1-464a-adda-0fd5dcedbdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:29.150821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e4bd-7bd1-464a-adda-0fd5dcedbdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:29.151106 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e4bd-7bd1-464a-adda-0fd5dcedbdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:29.151387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e4bd-7bd1-464a-adda-0fd5dcedbdc6 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:29.152123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9e4bd-7bd1-464a-adda-0fd5dcedbdc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:29.152433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9e4bd-7bd1-464a-adda-0fd5dcedbdc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:29.153807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9e4bd-7bd1-464a-adda-0fd5dcedbdc6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:29.159826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 460/923] 10.222.0.49 () {56 vars in 1114 bytes} [Tue Jun 28 11:56:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:29.165343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a59a71-2686-4fe8-8aac-efcd5ede85dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:29.273310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a59a71-2686-4fe8-8aac-efcd5ede85dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:29.305447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:29.308625 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7179e10-a655-4a5f-b740-76bec8157972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:29.309278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179e10-a655-4a5f-b740-76bec8157972 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:29.309563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179e10-a655-4a5f-b740-76bec8157972 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:29.309834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7179e10-a655-4a5f-b740-76bec8157972 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:29.310591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7179e10-a655-4a5f-b740-76bec8157972 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:29.311980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7179e10-a655-4a5f-b740-76bec8157972 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:29.432798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 464/924] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Jun 28 11:56:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:30.091191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706782-66a2-474d-a84c-6b886912b947 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.091737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706782-66a2-474d-a84c-6b886912b947 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.091737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706782-66a2-474d-a84c-6b886912b947 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.093394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 461/925] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:30.098792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97966532-f40c-452b-b002-c320162c2ac9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.099132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97966532-f40c-452b-b002-c320162c2ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.099421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97966532-f40c-452b-b002-c320162c2ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.117336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-97966532-f40c-452b-b002-c320162c2ac9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:30.118531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-97966532-f40c-452b-b002-c320162c2ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:30.195217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 465/926] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:30.218368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64706782-66a2-474d-a84c-6b886912b947 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:30.256694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:30.325602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64706782-66a2-474d-a84c-6b886912b947 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:30.361051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df872d-8c54-4333-ae1a-fdf462a2cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:30.361878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df872d-8c54-4333-ae1a-fdf462a2cd27 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.362160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df872d-8c54-4333-ae1a-fdf462a2cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.362434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df872d-8c54-4333-ae1a-fdf462a2cd27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.363093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df872d-8c54-4333-ae1a-fdf462a2cd27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:30.364491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df872d-8c54-4333-ae1a-fdf462a2cd27 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:30.375631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37be40-ff49-45e8-96c4-3dd0cef6737f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.376165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37be40-ff49-45e8-96c4-3dd0cef6737f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.376261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37be40-ff49-45e8-96c4-3dd0cef6737f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.378335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 466/927] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b6df872d-8c54-4333-ae1a-fdf462a2cd27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:30.379037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:30.380090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:30.380924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 462/928] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:30.388152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93d37d-1542-40b8-92af-486587e1becc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.388452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93d37d-1542-40b8-92af-486587e1becc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.388793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93d37d-1542-40b8-92af-486587e1becc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.389489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df872d-8c54-4333-ae1a-fdf462a2cd27 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:30.412259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5b93d37d-1542-40b8-92af-486587e1becc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:30.413809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5b93d37d-1542-40b8-92af-486587e1becc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:30.511740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 467/929] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:30.518153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:30.528321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df872d-8c54-4333-ae1a-fdf462a2cd27 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:30.533423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1b4c2-38a2-47e8-86f3-c7672205bf67 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.533707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1b4c2-38a2-47e8-86f3-c7672205bf67 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.533981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1b4c2-38a2-47e8-86f3-c7672205bf67 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.539186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 468/930] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:30.540064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1b4c2-38a2-47e8-86f3-c7672205bf67 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:30.571150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3ed1f-0882-4cd2-9c16-401d2a7d71f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:30.571818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3ed1f-0882-4cd2-9c16-401d2a7d71f4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.572144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3ed1f-0882-4cd2-9c16-401d2a7d71f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.572427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3ed1f-0882-4cd2-9c16-401d2a7d71f4 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.573141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3ed1f-0882-4cd2-9c16-401d2a7d71f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:30.573558 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3ed1f-0882-4cd2-9c16-401d2a7d71f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:30.574949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3ed1f-0882-4cd2-9c16-401d2a7d71f4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:30.585245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 463/931] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:30.585245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea5bee-321c-4888-a207-dfdbc017df07 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.585245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea5bee-321c-4888-a207-dfdbc017df07 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.585245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea5bee-321c-4888-a207-dfdbc017df07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.587789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:30.604807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5bea5bee-321c-4888-a207-dfdbc017df07 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:30.605991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5bea5bee-321c-4888-a207-dfdbc017df07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:30.653059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1b4c2-38a2-47e8-86f3-c7672205bf67 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:30.676653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 464/932] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:30.677765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea5bee-321c-4888-a207-dfdbc017df07 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:30.701633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f9d5-a027-49b8-97a2-85e1eff527a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:30.702499 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f9d5-a027-49b8-97a2-85e1eff527a8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.702782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f9d5-a027-49b8-97a2-85e1eff527a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.703077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1f9d5-a027-49b8-97a2-85e1eff527a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.713964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1f9d5-a027-49b8-97a2-85e1eff527a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-51f1f9d5-a027-49b8-97a2-85e1eff527a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:30.722660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:30.723647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:30.724534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 469/933] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Jun 28 11:56:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:30.726181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f9d5-a027-49b8-97a2-85e1eff527a8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:30.780402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:30.789144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea5bee-321c-4888-a207-dfdbc017df07 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:30.824986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80942c0e-bfa5-49cb-967e-dcb357ff40e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:30.825646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80942c0e-bfa5-49cb-967e-dcb357ff40e0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.825929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80942c0e-bfa5-49cb-967e-dcb357ff40e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.826257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80942c0e-bfa5-49cb-967e-dcb357ff40e0 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.826686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:30.827772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80942c0e-bfa5-49cb-967e-dcb357ff40e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:30.828125 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80942c0e-bfa5-49cb-967e-dcb357ff40e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:30.829527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80942c0e-bfa5-49cb-967e-dcb357ff40e0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:30.833696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1f9d5-a027-49b8-97a2-85e1eff527a8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:30.834572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 465/934] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:30.840109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80942c0e-bfa5-49cb-967e-dcb357ff40e0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:30.873878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3039a-11b9-4144-b2a2-b9c6894496e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:30.874668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3039a-11b9-4144-b2a2-b9c6894496e4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.874948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3039a-11b9-4144-b2a2-b9c6894496e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.875379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3039a-11b9-4144-b2a2-b9c6894496e4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.877375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3039a-11b9-4144-b2a2-b9c6894496e4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:30.878896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3039a-11b9-4144-b2a2-b9c6894496e4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9db3039a-11b9-4144-b2a2-b9c6894496e4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:30.890685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:30.891907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:30.892790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 470/935] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:30.893758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3039a-11b9-4144-b2a2-b9c6894496e4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:30.948421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80942c0e-bfa5-49cb-967e-dcb357ff40e0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:30.984534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3f74b-da81-4c15-9044-de7b096b4383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:30.985314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3f74b-da81-4c15-9044-de7b096b4383 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:30.985595 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3f74b-da81-4c15-9044-de7b096b4383 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:30.986408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3f74b-da81-4c15-9044-de7b096b4383 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:30.987162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3f74b-da81-4c15-9044-de7b096b4383 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:30.987470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3f74b-da81-4c15-9044-de7b096b4383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:30.988876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3f74b-da81-4c15-9044-de7b096b4383 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:30.997113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 466/936] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Jun 28 11:56:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:31.000239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3039a-11b9-4144-b2a2-b9c6894496e4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:31.003983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3f74b-da81-4c15-9044-de7b096b4383 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:31.023298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:31.037696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106173-0e34-4a09-827b-d2b234efcae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:31.042535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106173-0e34-4a09-827b-d2b234efcae0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.042535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106173-0e34-4a09-827b-d2b234efcae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.042535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106173-0e34-4a09-827b-d2b234efcae0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.042535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc106173-0e34-4a09-827b-d2b234efcae0 None admin] RBAC: Adding query filter params (interface=public, service_id=899b3e42713c4229a58c39a7dcfb5987, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:31.042535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc106173-0e34-4a09-827b-d2b234efcae0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:31.042535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc106173-0e34-4a09-827b-d2b234efcae0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:31.047195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 471/937] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Jun 28 11:56:30 2022] GET /identity/v3/endpoints?service_id=899b3e42713c4229a58c39a7dcfb5987&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:31.048108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106173-0e34-4a09-827b-d2b234efcae0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:31.079495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:31.114182 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3f74b-da81-4c15-9044-de7b096b4383 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:31.156330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f46f7-12eb-497e-a03b-8ad9c4afa911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:31.157000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f46f7-12eb-497e-a03b-8ad9c4afa911 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.157302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f46f7-12eb-497e-a03b-8ad9c4afa911 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.157478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106173-0e34-4a09-827b-d2b234efcae0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:31.158095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f46f7-12eb-497e-a03b-8ad9c4afa911 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.158883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f46f7-12eb-497e-a03b-8ad9c4afa911 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:31.159190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f46f7-12eb-497e-a03b-8ad9c4afa911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:31.160941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f46f7-12eb-497e-a03b-8ad9c4afa911 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:31.170079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 467/938] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:31.170079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f46f7-12eb-497e-a03b-8ad9c4afa911 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:31.200558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cb3ca-e94d-40ba-963f-a2198db22a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:31.201299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb3ca-e94d-40ba-963f-a2198db22a9a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.201543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb3ca-e94d-40ba-963f-a2198db22a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.201817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb3ca-e94d-40ba-963f-a2198db22a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.212313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb3ca-e94d-40ba-963f-a2198db22a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:31.213745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb3ca-e94d-40ba-963f-a2198db22a9a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ce1cb3ca-e94d-40ba-963f-a2198db22a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:31.233066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:31.234162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:31.235085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:31.235085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:31.235085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:31.235085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:31.235085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 472/939] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:31.235085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cb3ca-e94d-40ba-963f-a2198db22a9a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:31.261059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:31.280261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f46f7-12eb-497e-a03b-8ad9c4afa911 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:31.315848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ffcca-a2eb-4fcd-8b8b-60b902089ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:31.316535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ffcca-a2eb-4fcd-8b8b-60b902089ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.316813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ffcca-a2eb-4fcd-8b8b-60b902089ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.317085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ffcca-a2eb-4fcd-8b8b-60b902089ea7 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.317764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ffcca-a2eb-4fcd-8b8b-60b902089ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:31.318664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:31.319218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ffcca-a2eb-4fcd-8b8b-60b902089ea7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:31.325559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 468/940] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Jun 28 11:56:31 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 11:56:31.326557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ffcca-a2eb-4fcd-8b8b-60b902089ea7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:31.357515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cb3ca-e94d-40ba-963f-a2198db22a9a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:31.407047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9378e6-0268-45c1-bcd0-e7876319804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:31.408851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9378e6-0268-45c1-bcd0-e7876319804b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.409423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9378e6-0268-45c1-bcd0-e7876319804b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.409765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9378e6-0268-45c1-bcd0-e7876319804b None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.410573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9378e6-0268-45c1-bcd0-e7876319804b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:31.410956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9378e6-0268-45c1-bcd0-e7876319804b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:31.412477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9378e6-0268-45c1-bcd0-e7876319804b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:31.419090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 473/941] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:31.470643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ffcca-a2eb-4fcd-8b8b-60b902089ea7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:31.515203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9da3-f1de-4a38-96e1-48b6432f36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:31.516305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9da3-f1de-4a38-96e1-48b6432f36fe None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.516746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9da3-f1de-4a38-96e1-48b6432f36fe None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.517970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9da3-f1de-4a38-96e1-48b6432f36fe None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.518952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb9da3-f1de-4a38-96e1-48b6432f36fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:31.519451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb9da3-f1de-4a38-96e1-48b6432f36fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:31.521144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb9da3-f1de-4a38-96e1-48b6432f36fe None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:31.537087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 469/942] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:31.543216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9378e6-0268-45c1-bcd0-e7876319804b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:31.555180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b7ee5-d528-4725-9f0a-073e37cc0796 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.555555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b7ee5-d528-4725-9f0a-073e37cc0796 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.555840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b7ee5-d528-4725-9f0a-073e37cc0796 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.558080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 470/943] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:31.563519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22103e-4dd0-4513-b8b8-5388dd8a3820 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.563927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22103e-4dd0-4513-b8b8-5388dd8a3820 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.564794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22103e-4dd0-4513-b8b8-5388dd8a3820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.581908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:31.590770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ae22103e-4dd0-4513-b8b8-5388dd8a3820 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:31.593539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ae22103e-4dd0-4513-b8b8-5388dd8a3820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:31.674609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9378e6-0268-45c1-bcd0-e7876319804b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:31.687632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 471/944] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:31.712008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22103e-4dd0-4513-b8b8-5388dd8a3820 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:31.725786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b3fff-0af5-4804-9ad3-edcac17968f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:31.727245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b3fff-0af5-4804-9ad3-edcac17968f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.727853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b3fff-0af5-4804-9ad3-edcac17968f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.728366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b3fff-0af5-4804-9ad3-edcac17968f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.737046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b3fff-0af5-4804-9ad3-edcac17968f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:31.738920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b3fff-0af5-4804-9ad3-edcac17968f6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b41b3fff-0af5-4804-9ad3-edcac17968f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:31.756310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:31.757563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:31.758511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:31.761459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 474/945] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:56:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:31.764072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:31.766670 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b3fff-0af5-4804-9ad3-edcac17968f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:31.817280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22103e-4dd0-4513-b8b8-5388dd8a3820 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:31.853522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:31.854198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.854484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.854763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.855489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:31.856978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:31.858357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WARNING keystone.server.flask.common [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 28 11:56:31.863067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:31.879520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b3fff-0af5-4804-9ad3-edcac17968f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:31.915648 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acab5d-f271-4e1a-b7cf-63079fba19f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:31.916359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acab5d-f271-4e1a-b7cf-63079fba19f7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:31.916646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acab5d-f271-4e1a-b7cf-63079fba19f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:31.916921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acab5d-f271-4e1a-b7cf-63079fba19f7 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:31.917764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acab5d-f271-4e1a-b7cf-63079fba19f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:31.918075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acab5d-f271-4e1a-b7cf-63079fba19f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:31.919512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acab5d-f271-4e1a-b7cf-63079fba19f7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:31.920314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.sql.core [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 28 11:56:31.920314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 28 11:56:31.920314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [parameters: {'id': 'ec97e206465f4fbbba10d22528c4cfc9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 28 11:56:31.920314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80314) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ec97e206465f4fbbba10d22528c4cfc9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ec97e206465f4fbbba10d22528c4cfc9. Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application conn.query(q) Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 11:56:31.933204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application result.read() Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 28 11:56:31.934087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application next(self.gen) Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application yield resource Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application next(self.gen) Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.session.rollback() Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.force_reraise() Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise self.value Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application session.commit() Jun 28 11:56:31.935075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._prepare_impl() Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.session.flush() Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._flush(objects) Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application compat.raise_( Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application flush_context.execute() Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 28 11:56:31.935985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rec.execute(self) Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 28 11:56:31.937681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application conn.query(q) Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application result.read() Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 11:56:31.939010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [parameters: {'id': 'ec97e206465f4fbbba10d22528c4cfc9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:31.941307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:31.943188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ec97e206465f4fbbba10d22528c4cfc9. Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:31.945912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 472/946] 10.222.0.49 () {60 vars in 1140 bytes} [Tue Jun 28 11:56:31 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:31.947347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 475/947] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Jun 28 11:56:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:31.947490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:31.953052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acab5d-f271-4e1a-b7cf-63079fba19f7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:32.020476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:32.068697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff666012-f7e3-4e70-9364-d8e02ccdb3bc None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:32.080908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acab5d-f271-4e1a-b7cf-63079fba19f7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:32.114805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebdefd-69be-4334-b929-0f14a978638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:32.116263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebdefd-69be-4334-b929-0f14a978638b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:32.116855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebdefd-69be-4334-b929-0f14a978638b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:32.117283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebdefd-69be-4334-b929-0f14a978638b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:32.118035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd8008-bd83-4550-ab13-54686a893735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:32.118904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8008-bd83-4550-ab13-54686a893735 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:32.119260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8008-bd83-4550-ab13-54686a893735 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:32.119609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8008-bd83-4550-ab13-54686a893735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:32.126026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebdefd-69be-4334-b929-0f14a978638b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:32.129060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebdefd-69be-4334-b929-0f14a978638b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:32.131005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd8008-bd83-4550-ab13-54686a893735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:32.132702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd8008-bd83-4550-ab13-54686a893735 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-74ebdefd-69be-4334-b929-0f14a978638b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:32.147517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:32.148689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:32.149775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:32.149775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:32.149775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:32.149775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:32.149775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:32.149775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:32.149775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:32.149775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:32.151901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 473/948] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-38fd8008-bd83-4550-ab13-54686a893735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:32.154741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:32.155586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:32.156503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:32.156503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:32.156503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:32.156503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:32.158446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebdefd-69be-4334-b929-0f14a978638b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:32.159238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 476/949] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:32.165045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd8008-bd83-4550-ab13-54686a893735 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:32.228717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:32.276867 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebdefd-69be-4334-b929-0f14a978638b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:32.292243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd8008-bd83-4550-ab13-54686a893735 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:32.305739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:32.312692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2096b-06b6-4986-9754-25d7e2e211f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:32.313058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2096b-06b6-4986-9754-25d7e2e211f0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:32.316740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2096b-06b6-4986-9754-25d7e2e211f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:32.316740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2096b-06b6-4986-9754-25d7e2e211f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:32.316740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2096b-06b6-4986-9754-25d7e2e211f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:32.316740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2096b-06b6-4986-9754-25d7e2e211f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:32.317028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2096b-06b6-4986-9754-25d7e2e211f0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:32.336721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5580b8-50f0-4026-a766-496d776a1d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:32.337704 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5580b8-50f0-4026-a766-496d776a1d56 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:32.338191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5580b8-50f0-4026-a766-496d776a1d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:32.338641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 474/950] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:32.338806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5580b8-50f0-4026-a766-496d776a1d56 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:32.339554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5580b8-50f0-4026-a766-496d776a1d56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:32.339900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5580b8-50f0-4026-a766-496d776a1d56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:32.341280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5580b8-50f0-4026-a766-496d776a1d56 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:32.358462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 477/951] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:32.365336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2096b-06b6-4986-9754-25d7e2e211f0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:32.482283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2096b-06b6-4986-9754-25d7e2e211f0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:32.497201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:32.524127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf86628-bfe1-48e0-8eec-d68c84b6fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:32.524964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf86628-bfe1-48e0-8eec-d68c84b6fa70 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:32.525248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf86628-bfe1-48e0-8eec-d68c84b6fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:32.525526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf86628-bfe1-48e0-8eec-d68c84b6fa70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:32.535360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf86628-bfe1-48e0-8eec-d68c84b6fa70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:32.537720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf86628-bfe1-48e0-8eec-d68c84b6fa70 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-bdf86628-bfe1-48e0-8eec-d68c84b6fa70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:32.554080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:32.555074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:32.556082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:32.556082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:32.556082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:32.556082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:32.556082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:32.556082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:32.556082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:32.556082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:32.556082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 475/952] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:32.562335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5580b8-50f0-4026-a766-496d776a1d56 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:32.674771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5580b8-50f0-4026-a766-496d776a1d56 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:32.711332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e1987-02db-46b6-937c-a40e51b8da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:32.712179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1987-02db-46b6-937c-a40e51b8da78 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:32.712535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1987-02db-46b6-937c-a40e51b8da78 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:32.712882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e1987-02db-46b6-937c-a40e51b8da78 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:32.713754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e1987-02db-46b6-937c-a40e51b8da78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:32.714153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e1987-02db-46b6-937c-a40e51b8da78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:32.715658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e1987-02db-46b6-937c-a40e51b8da78 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:32.729160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 478/953] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:32.734640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf86628-bfe1-48e0-8eec-d68c84b6fa70 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:32.838803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf86628-bfe1-48e0-8eec-d68c84b6fa70 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:32.873545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bb2e3-5da7-4886-b688-375b6d49ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:32.874449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb2e3-5da7-4886-b688-375b6d49ecbb None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:32.874731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb2e3-5da7-4886-b688-375b6d49ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:32.875006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bb2e3-5da7-4886-b688-375b6d49ecbb None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/a633011057f643218e20293412f8108f/roles/0c79e2ac1c3248618dfc1b9f7374a15a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:32.877981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bb2e3-5da7-4886-b688-375b6d49ecbb None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=a633011057f643218e20293412f8108f, role_id=0c79e2ac1c3248618dfc1b9f7374a15a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:32.879429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bb2e3-5da7-4886-b688-375b6d49ecbb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:32.959191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 476/954] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:56:32 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/a633011057f643218e20293412f8108f/roles/0c79e2ac1c3248618dfc1b9f7374a15a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:56:33.473754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3ad8e-7ced-49fa-b4de-247207e6ea1c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:33.474158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3ad8e-7ced-49fa-b4de-247207e6ea1c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:33.474339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3ad8e-7ced-49fa-b4de-247207e6ea1c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:33.476104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 479/955] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:33.481381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6714-8ebe-494b-82f0-7f8cb9dbfeaa None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:33.481815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6714-8ebe-494b-82f0-7f8cb9dbfeaa None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:33.481999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6714-8ebe-494b-82f0-7f8cb9dbfeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:33.499424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-346e6714-8ebe-494b-82f0-7f8cb9dbfeaa None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:33.500981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-346e6714-8ebe-494b-82f0-7f8cb9dbfeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:33.528578 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:33.571824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 477/956] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:33.595605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3ad8e-7ced-49fa-b4de-247207e6ea1c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:33.618708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da62cec-3fba-48b4-afb4-840d04d554c7 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:33.619026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da62cec-3fba-48b4-afb4-840d04d554c7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:33.619259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da62cec-3fba-48b4-afb4-840d04d554c7 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:33.621023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 478/957] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:33.629136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad026c8-a027-4d2e-b5f2-ff2f289c9744 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:33.629570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad026c8-a027-4d2e-b5f2-ff2f289c9744 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:33.629987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad026c8-a027-4d2e-b5f2-ff2f289c9744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:33.634786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:33.650330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-cad026c8-a027-4d2e-b5f2-ff2f289c9744 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:33.651664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cad026c8-a027-4d2e-b5f2-ff2f289c9744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:33.726853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3ad8e-7ced-49fa-b4de-247207e6ea1c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:33.749847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 479/958] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:33.765249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904dc6f-a085-477b-9097-5e90aba9960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:33.766057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904dc6f-a085-477b-9097-5e90aba9960a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:33.766340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904dc6f-a085-477b-9097-5e90aba9960a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:33.766616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904dc6f-a085-477b-9097-5e90aba9960a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:33.768237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904dc6f-a085-477b-9097-5e90aba9960a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:33.769609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904dc6f-a085-477b-9097-5e90aba9960a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:33.774504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad026c8-a027-4d2e-b5f2-ff2f289c9744 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f904dc6f-a085-477b-9097-5e90aba9960a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:33.785237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:33.786413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:33.787299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:33.794863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 480/959] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:33.795912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904dc6f-a085-477b-9097-5e90aba9960a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:33.890972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:33.892976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:33.902528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904dc6f-a085-477b-9097-5e90aba9960a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:33.910184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad026c8-a027-4d2e-b5f2-ff2f289c9744 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:33.938243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd220-47e0-485f-a9b2-8e8de95491f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:33.939499 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd220-47e0-485f-a9b2-8e8de95491f4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:33.940039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd220-47e0-485f-a9b2-8e8de95491f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:33.940532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd220-47e0-485f-a9b2-8e8de95491f4 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:33.941452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd220-47e0-485f-a9b2-8e8de95491f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:33.942129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd220-47e0-485f-a9b2-8e8de95491f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:33.944142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd220-47e0-485f-a9b2-8e8de95491f4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:33.945077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe704-ccf0-41ec-a800-6a5998f751a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:33.945913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe704-ccf0-41ec-a800-6a5998f751a2 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:33.946201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe704-ccf0-41ec-a800-6a5998f751a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:33.946479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fe704-ccf0-41ec-a800-6a5998f751a2 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:33.947501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fe704-ccf0-41ec-a800-6a5998f751a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:33.949194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fe704-ccf0-41ec-a800-6a5998f751a2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:33.955713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 481/960] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:33.957241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd220-47e0-485f-a9b2-8e8de95491f4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:34.040549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 480/961] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:56:33 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:34.070110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd220-47e0-485f-a9b2-8e8de95491f4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:34.118849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8579a-5817-42fe-aa84-8b9c9ba6766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:34.119548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8579a-5817-42fe-aa84-8b9c9ba6766a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:34.119835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8579a-5817-42fe-aa84-8b9c9ba6766a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:34.120221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8579a-5817-42fe-aa84-8b9c9ba6766a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:34.120965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8579a-5817-42fe-aa84-8b9c9ba6766a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:34.121274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8579a-5817-42fe-aa84-8b9c9ba6766a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:34.122723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8579a-5817-42fe-aa84-8b9c9ba6766a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:34.129651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 482/962] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:34.135427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe704-ccf0-41ec-a800-6a5998f751a2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:34.252556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fe704-ccf0-41ec-a800-6a5998f751a2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:34.290657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf859-eb40-48e8-854b-fd74e6e80ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:34.291661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf859-eb40-48e8-854b-fd74e6e80ed1 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:34.292186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf859-eb40-48e8-854b-fd74e6e80ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:34.292662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf859-eb40-48e8-854b-fd74e6e80ed1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:34.293702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbf859-eb40-48e8-854b-fd74e6e80ed1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:34.295306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbf859-eb40-48e8-854b-fd74e6e80ed1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:34.405326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 481/963] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Jun 28 11:56:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:34.574163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b82df-cb64-4752-9066-ddec59256fd5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:34.574347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b82df-cb64-4752-9066-ddec59256fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:34.574625 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b82df-cb64-4752-9066-ddec59256fd5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:34.576287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 483/964] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:34.581784 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7977-9871-4cdd-be6a-a7f7e3803031 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:34.582245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7977-9871-4cdd-be6a-a7f7e3803031 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:34.582323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7977-9871-4cdd-be6a-a7f7e3803031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:34.600488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ba7a7977-9871-4cdd-be6a-a7f7e3803031 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:34.601675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ba7a7977-9871-4cdd-be6a-a7f7e3803031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:34.603780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:34.678168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 482/965] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:34.703563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b82df-cb64-4752-9066-ddec59256fd5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:34.723507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:34.813567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b82df-cb64-4752-9066-ddec59256fd5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:34.850060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b474aee-19df-42dd-ae1a-6c0d80848a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:34.851416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474aee-19df-42dd-ae1a-6c0d80848a94 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:34.851937 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474aee-19df-42dd-ae1a-6c0d80848a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:34.852476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474aee-19df-42dd-ae1a-6c0d80848a94 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:34.853476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b474aee-19df-42dd-ae1a-6c0d80848a94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:34.855150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b474aee-19df-42dd-ae1a-6c0d80848a94 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:34.856908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING keystone.server.flask.common [None req-9b474aee-19df-42dd-ae1a-6c0d80848a94 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 28 11:56:34.914600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.sql.core [None req-9b474aee-19df-42dd-ae1a-6c0d80848a94 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 28 11:56:34.914600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 28 11:56:34.914600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [parameters: {'user_id': '71fe23e65c0a4aa9ab44426f02cc1b0d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 28 11:56:34.914600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80315) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9b474aee-19df-42dd-ae1a-6c0d80848a94 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jun 28 11:56:34.933389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 11:56:34.934339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application yield resource Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.rollback() Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.force_reraise() Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise self.value Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application session.commit() Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 28 11:56:34.935411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._prepare_impl() Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.flush() Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._flush(objects) Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application compat.raise_( Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application flush_context.execute() Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rec.execute(self) Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 28 11:56:34.936353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 11:56:34.937910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 11:56:34.938778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [parameters: {'user_id': '71fe23e65c0a4aa9ab44426f02cc1b0d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:34.939613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 28 11:56:34.940462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 28 11:56:34.942740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 28 11:56:34.942740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 28 11:56:34.942740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 28 11:56:34.942740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 28 11:56:34.942740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 28 11:56:34.942740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:34.945488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 484/966] 10.222.0.49 () {60 vars in 1131 bytes} [Tue Jun 28 11:56:34 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:34.951016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a7977-9871-4cdd-be6a-a7f7e3803031 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:35.052551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a7977-9871-4cdd-be6a-a7f7e3803031 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:35.070796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cdeb5-7749-4b89-ad75-632e4a518133 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:35.071085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cdeb5-7749-4b89-ad75-632e4a518133 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:35.071363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cdeb5-7749-4b89-ad75-632e4a518133 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:35.075927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 485/967] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:35.080860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aadba-ea94-4763-bdad-9ce154a8cd5a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:35.081151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aadba-ea94-4763-bdad-9ce154a8cd5a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:35.081435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3aadba-ea94-4763-bdad-9ce154a8cd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:35.090634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ef456-1932-4bbb-84da-34d41f47d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:35.091685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ef456-1932-4bbb-84da-34d41f47d682 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:35.092169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ef456-1932-4bbb-84da-34d41f47d682 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:35.092618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ef456-1932-4bbb-84da-34d41f47d682 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:35.095656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:35.102040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ef456-1932-4bbb-84da-34d41f47d682 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:35.102487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8e3aadba-ea94-4763-bdad-9ce154a8cd5a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:35.103560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ef456-1932-4bbb-84da-34d41f47d682 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:35.104501 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e3aadba-ea94-4763-bdad-9ce154a8cd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e74ef456-1932-4bbb-84da-34d41f47d682 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:35.120608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:35.121632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:35.122589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 483/968] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:35.128324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ef456-1932-4bbb-84da-34d41f47d682 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:35.194994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 486/969] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:35.218612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aadba-ea94-4763-bdad-9ce154a8cd5a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:35.231511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:35.251964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ef456-1932-4bbb-84da-34d41f47d682 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:35.290967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe779-19dc-4a2d-bd8a-18f7538c35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:35.291644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe779-19dc-4a2d-bd8a-18f7538c35fb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:35.291950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe779-19dc-4a2d-bd8a-18f7538c35fb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:35.292229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbe779-19dc-4a2d-bd8a-18f7538c35fb None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:35.293054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbe779-19dc-4a2d-bd8a-18f7538c35fb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:35.293362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbe779-19dc-4a2d-bd8a-18f7538c35fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:35.294804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbe779-19dc-4a2d-bd8a-18f7538c35fb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:35.331381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 484/970] 10.222.0.49 () {56 vars in 1101 bytes} [Tue Jun 28 11:56:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:35.353102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3aadba-ea94-4763-bdad-9ce154a8cd5a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:35.392610 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34503b1-84be-4b3f-b552-df332e1dd0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:35.394135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34503b1-84be-4b3f-b552-df332e1dd0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:35.394799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34503b1-84be-4b3f-b552-df332e1dd0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:35.395229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34503b1-84be-4b3f-b552-df332e1dd0a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:35.408046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34503b1-84be-4b3f-b552-df332e1dd0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c34503b1-84be-4b3f-b552-df332e1dd0a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:35.416930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:35.418134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:35.419208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:35.421863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 487/971] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Jun 28 11:56:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:35.428414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe779-19dc-4a2d-bd8a-18f7538c35fb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:35.493134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:35.547851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbe779-19dc-4a2d-bd8a-18f7538c35fb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:35.583236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d79a58-a839-4083-8c13-ee74af827a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:35.584000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79a58-a839-4083-8c13-ee74af827a7a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:35.584207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79a58-a839-4083-8c13-ee74af827a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:35.584483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79a58-a839-4083-8c13-ee74af827a7a None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:35.585237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d79a58-a839-4083-8c13-ee74af827a7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:35.585541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d79a58-a839-4083-8c13-ee74af827a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:35.586913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d79a58-a839-4083-8c13-ee74af827a7a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:35.596569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 485/972] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Jun 28 11:56:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:35.602100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34503b1-84be-4b3f-b552-df332e1dd0a5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:35.671316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:35.705779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34503b1-84be-4b3f-b552-df332e1dd0a5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:35.741336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7eebd-7b56-402a-87ce-902604a97c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:35.742129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7eebd-7b56-402a-87ce-902604a97c1a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:35.742407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7eebd-7b56-402a-87ce-902604a97c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:35.742677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7eebd-7b56-402a-87ce-902604a97c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:35.753546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7eebd-7b56-402a-87ce-902604a97c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:35.755165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7eebd-7b56-402a-87ce-902604a97c1a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3ba7eebd-7b56-402a-87ce-902604a97c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:35.772663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:35.773589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:35.774645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:35.774645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:35.774645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:35.774645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:35.774645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 488/973] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:35.779497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d79a58-a839-4083-8c13-ee74af827a7a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:35.881082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d79a58-a839-4083-8c13-ee74af827a7a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:35.894963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:35.915287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84cf99-b8dd-4bfc-9cee-1b30fb059d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:35.916016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84cf99-b8dd-4bfc-9cee-1b30fb059d05 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:35.916308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84cf99-b8dd-4bfc-9cee-1b30fb059d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:35.916587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84cf99-b8dd-4bfc-9cee-1b30fb059d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:35.917313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84cf99-b8dd-4bfc-9cee-1b30fb059d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:35.917627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84cf99-b8dd-4bfc-9cee-1b30fb059d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:35.919087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84cf99-b8dd-4bfc-9cee-1b30fb059d05 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:35.931549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 486/974] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:35.936306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7eebd-7b56-402a-87ce-902604a97c1a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.038935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7eebd-7b56-402a-87ce-902604a97c1a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:36.058408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:36.072689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90c7db-1853-4b61-a260-173ede1779c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:36.073543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90c7db-1853-4b61-a260-173ede1779c4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.073826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90c7db-1853-4b61-a260-173ede1779c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.074100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90c7db-1853-4b61-a260-173ede1779c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.082310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90c7db-1853-4b61-a260-173ede1779c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:36.083750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90c7db-1853-4b61-a260-173ede1779c4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0b90c7db-1853-4b61-a260-173ede1779c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:36.101481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:36.102495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:36.103481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 489/975] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:56:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:36.110084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84cf99-b8dd-4bfc-9cee-1b30fb059d05 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.209998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84cf99-b8dd-4bfc-9cee-1b30fb059d05 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:36.244312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef8bca-e6cc-4992-9dd7-28e3ddc78b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:36.244979 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8bca-e6cc-4992-9dd7-28e3ddc78b29 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.245258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8bca-e6cc-4992-9dd7-28e3ddc78b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.245530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8bca-e6cc-4992-9dd7-28e3ddc78b29 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.246365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef8bca-e6cc-4992-9dd7-28e3ddc78b29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:36.246670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef8bca-e6cc-4992-9dd7-28e3ddc78b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:36.248130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef8bca-e6cc-4992-9dd7-28e3ddc78b29 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:36.258414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b828-9294-4bb5-8b06-3358512bbfb1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.258703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b828-9294-4bb5-8b06-3358512bbfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.258982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b828-9294-4bb5-8b06-3358512bbfb1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.260530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 490/976] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:36.265342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce021b7-a36c-44a2-b987-ec74cf7aaefa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.265634 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce021b7-a36c-44a2-b987-ec74cf7aaefa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.265914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce021b7-a36c-44a2-b987-ec74cf7aaefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.271081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 487/977] 10.222.0.49 () {56 vars in 1149 bytes} [Tue Jun 28 11:56:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:36.272158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef8bca-e6cc-4992-9dd7-28e3ddc78b29 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.285091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5ce021b7-a36c-44a2-b987-ec74cf7aaefa None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:36.286301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5ce021b7-a36c-44a2-b987-ec74cf7aaefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:36.303329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:36.356989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 491/978] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:36.378759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef8bca-e6cc-4992-9dd7-28e3ddc78b29 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:36.380710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce021b7-a36c-44a2-b987-ec74cf7aaefa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.416378 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde64532-2402-45c8-8eff-0f87fbdd70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:36.417033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64532-2402-45c8-8eff-0f87fbdd70c9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.417319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64532-2402-45c8-8eff-0f87fbdd70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.417600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64532-2402-45c8-8eff-0f87fbdd70c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.485687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce021b7-a36c-44a2-b987-ec74cf7aaefa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:36.489791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde64532-2402-45c8-8eff-0f87fbdd70c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:36.491267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde64532-2402-45c8-8eff-0f87fbdd70c9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:36.499221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:36.527852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:36.533957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc1616-e451-4e2a-82e8-6afd0ddc7dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:36.534823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1616-e451-4e2a-82e8-6afd0ddc7dda None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.541572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1616-e451-4e2a-82e8-6afd0ddc7dda None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.541572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1616-e451-4e2a-82e8-6afd0ddc7dda None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.541572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc1616-e451-4e2a-82e8-6afd0ddc7dda None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:36.541572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc1616-e451-4e2a-82e8-6afd0ddc7dda None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-19bc1616-e451-4e2a-82e8-6afd0ddc7dda None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:36.549424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:36.550419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:36.552781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 492/979] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:36.556815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc1616-e451-4e2a-82e8-6afd0ddc7dda None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.605490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 488/980] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:36 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:36.608562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f44bee-6314-4929-9d89-36afe56e6a67 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.609745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f44bee-6314-4929-9d89-36afe56e6a67 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.610030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f44bee-6314-4929-9d89-36afe56e6a67 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.611949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 489/981] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:36.612642 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f44bee-6314-4929-9d89-36afe56e6a67 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.665285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc1616-e451-4e2a-82e8-6afd0ddc7dda None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:36.700077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589c776-e48e-4447-9c8e-df12d45910ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:36.700745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c776-e48e-4447-9c8e-df12d45910ee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.701029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c776-e48e-4447-9c8e-df12d45910ee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.701312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c776-e48e-4447-9c8e-df12d45910ee None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.702013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c776-e48e-4447-9c8e-df12d45910ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:36.702320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c776-e48e-4447-9c8e-df12d45910ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:36.703673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c776-e48e-4447-9c8e-df12d45910ee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:36.708863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 493/982] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:36.710307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04efb3e-f45f-4abe-b6b7-ad57ae13b767 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.710600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04efb3e-f45f-4abe-b6b7-ad57ae13b767 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.710721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f44bee-6314-4929-9d89-36afe56e6a67 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:36.710886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04efb3e-f45f-4abe-b6b7-ad57ae13b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.727559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a04efb3e-f45f-4abe-b6b7-ad57ae13b767 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:36.728800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a04efb3e-f45f-4abe-b6b7-ad57ae13b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:36.742159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:36.747075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4749-cd6a-4e7a-ba64-2a5cb13ce783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:36.747863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4749-cd6a-4e7a-ba64-2a5cb13ce783 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.748169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4749-cd6a-4e7a-ba64-2a5cb13ce783 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.748438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4749-cd6a-4e7a-ba64-2a5cb13ce783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.758822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd4749-cd6a-4e7a-ba64-2a5cb13ce783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:36.759105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:36.760301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd4749-cd6a-4e7a-ba64-2a5cb13ce783 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-53cd4749-cd6a-4e7a-ba64-2a5cb13ce783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:36.777672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:36.778567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:36.779528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:36.779528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:36.779528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:36.779528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:36.779528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 490/983] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:36.779812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4749-cd6a-4e7a-ba64-2a5cb13ce783 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.801702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 494/984] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:36.802685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04efb3e-f45f-4abe-b6b7-ad57ae13b767 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.878972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4749-cd6a-4e7a-ba64-2a5cb13ce783 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:36.908765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04efb3e-f45f-4abe-b6b7-ad57ae13b767 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:36.911862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb837c8-3bbd-465a-ac66-6eee2ec67a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:36.912541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb837c8-3bbd-465a-ac66-6eee2ec67a24 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.912822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb837c8-3bbd-465a-ac66-6eee2ec67a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.913096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb837c8-3bbd-465a-ac66-6eee2ec67a24 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.913800 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb837c8-3bbd-465a-ac66-6eee2ec67a24 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:36.914105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb837c8-3bbd-465a-ac66-6eee2ec67a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:36.915468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb837c8-3bbd-465a-ac66-6eee2ec67a24 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:36.920274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 491/985] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:36.921128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb837c8-3bbd-465a-ac66-6eee2ec67a24 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.947791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5a82a-b127-4717-ba72-47a69cbd6cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:36.948477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a82a-b127-4717-ba72-47a69cbd6cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:36.948759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a82a-b127-4717-ba72-47a69cbd6cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:36.949033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5a82a-b127-4717-ba72-47a69cbd6cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:36.949751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5a82a-b127-4717-ba72-47a69cbd6cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:36.950056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5a82a-b127-4717-ba72-47a69cbd6cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:36.951411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5a82a-b127-4717-ba72-47a69cbd6cc4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:36.962559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 495/986] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:36.963467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5a82a-b127-4717-ba72-47a69cbd6cc4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:36.973076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:36.991818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:37.024163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb837c8-3bbd-465a-ac66-6eee2ec67a24 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.057803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690597a5-1730-4de0-a189-d7876f172049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.058600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690597a5-1730-4de0-a189-d7876f172049 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.058878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690597a5-1730-4de0-a189-d7876f172049 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.059156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690597a5-1730-4de0-a189-d7876f172049 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.059800 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690597a5-1730-4de0-a189-d7876f172049 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.061227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690597a5-1730-4de0-a189-d7876f172049 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.062022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5a82a-b127-4717-ba72-47a69cbd6cc4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-690597a5-1730-4de0-a189-d7876f172049 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:37.073121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:37.074283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:37.075302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 492/987] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:37.076255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690597a5-1730-4de0-a189-d7876f172049 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:37.099555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30083d1d-634d-4882-b65c-fd8a6a0689cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.100483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30083d1d-634d-4882-b65c-fd8a6a0689cf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.100761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30083d1d-634d-4882-b65c-fd8a6a0689cf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.101035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30083d1d-634d-4882-b65c-fd8a6a0689cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.101820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30083d1d-634d-4882-b65c-fd8a6a0689cf None admin] RBAC: Adding query filter params (interface=public, service_id=0ca4c4dd3077443ca54b630b629b7d5a, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:37.102133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30083d1d-634d-4882-b65c-fd8a6a0689cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.103482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30083d1d-634d-4882-b65c-fd8a6a0689cf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.108436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 496/988] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Jun 28 11:56:36 2022] GET /identity/v3/endpoints?service_id=0ca4c4dd3077443ca54b630b629b7d5a&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:37.109186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30083d1d-634d-4882-b65c-fd8a6a0689cf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:37.175702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690597a5-1730-4de0-a189-d7876f172049 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.187909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:37.198701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:37.207797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30083d1d-634d-4882-b65c-fd8a6a0689cf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.209379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b96ae-f4e7-4bf3-ad8f-4addd440c474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.210211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b96ae-f4e7-4bf3-ad8f-4addd440c474 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.210722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b96ae-f4e7-4bf3-ad8f-4addd440c474 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.211101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b96ae-f4e7-4bf3-ad8f-4addd440c474 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.218189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b96ae-f4e7-4bf3-ad8f-4addd440c474 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.219625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b96ae-f4e7-4bf3-ad8f-4addd440c474 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-2c4b96ae-f4e7-4bf3-ad8f-4addd440c474 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:37.234095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:37.235109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:37.236385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:37.236385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:37.236385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:37.236385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:37.236385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:37.236385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:37.236385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:37.236385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:37.236385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 493/989] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:37.236882 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b96ae-f4e7-4bf3-ad8f-4addd440c474 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:37.246935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999ea1e-6f7f-4c7a-8e1d-a225ca33558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.247605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999ea1e-6f7f-4c7a-8e1d-a225ca33558d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.247914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999ea1e-6f7f-4c7a-8e1d-a225ca33558d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.248198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999ea1e-6f7f-4c7a-8e1d-a225ca33558d None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.248912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999ea1e-6f7f-4c7a-8e1d-a225ca33558d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:37.249222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999ea1e-6f7f-4c7a-8e1d-a225ca33558d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.250589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999ea1e-6f7f-4c7a-8e1d-a225ca33558d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.255811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 497/990] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:37.256648 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999ea1e-6f7f-4c7a-8e1d-a225ca33558d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:37.337063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b96ae-f4e7-4bf3-ad8f-4addd440c474 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.354178 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999ea1e-6f7f-4c7a-8e1d-a225ca33558d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.371561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbf61c-8899-4646-8eb4-7cfa7aae14d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.372267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbf61c-8899-4646-8eb4-7cfa7aae14d8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.372556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbf61c-8899-4646-8eb4-7cfa7aae14d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.372836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbf61c-8899-4646-8eb4-7cfa7aae14d8 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.373523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbf61c-8899-4646-8eb4-7cfa7aae14d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.374900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbf61c-8899-4646-8eb4-7cfa7aae14d8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.381730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 494/991] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Jun 28 11:56:37 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 11:56:37.382503 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbf61c-8899-4646-8eb4-7cfa7aae14d8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:37.388445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6d9f7-bafb-4cfa-bf3c-1418a13fac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.389127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d9f7-bafb-4cfa-bf3c-1418a13fac12 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.389410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d9f7-bafb-4cfa-bf3c-1418a13fac12 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.389685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d9f7-bafb-4cfa-bf3c-1418a13fac12 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.390493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6d9f7-bafb-4cfa-bf3c-1418a13fac12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:37.390804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6d9f7-bafb-4cfa-bf3c-1418a13fac12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.392693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6d9f7-bafb-4cfa-bf3c-1418a13fac12 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.410960 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 498/992] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:37.412239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6d9f7-bafb-4cfa-bf3c-1418a13fac12 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:37.427912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:37.434413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:37.500809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbf61c-8899-4646-8eb4-7cfa7aae14d8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.534817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6d9f7-bafb-4cfa-bf3c-1418a13fac12 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.542273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d986388-51d3-499f-9b45-9673c5bf624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.542947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d986388-51d3-499f-9b45-9673c5bf624c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.543232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d986388-51d3-499f-9b45-9673c5bf624c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.543512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d986388-51d3-499f-9b45-9673c5bf624c None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.544262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d986388-51d3-499f-9b45-9673c5bf624c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:37.544818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d986388-51d3-499f-9b45-9673c5bf624c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.545950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d986388-51d3-499f-9b45-9673c5bf624c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.555964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 495/993] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:37.558171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d986388-51d3-499f-9b45-9673c5bf624c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:37.586035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91e1b-48d8-4b55-8aff-a980dbe9d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.586941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91e1b-48d8-4b55-8aff-a980dbe9d2ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.587273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91e1b-48d8-4b55-8aff-a980dbe9d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.587919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb91e1b-48d8-4b55-8aff-a980dbe9d2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.589032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb91e1b-48d8-4b55-8aff-a980dbe9d2ba None admin] RBAC: Adding query filter params (role.id=0c79e2ac1c3248618dfc1b9f7374a15a, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=a633011057f643218e20293412f8108f) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:37.589349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb91e1b-48d8-4b55-8aff-a980dbe9d2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.591646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb91e1b-48d8-4b55-8aff-a980dbe9d2ba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.604091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 499/994] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:37 2022] GET /identity/v3/role_assignments?user.id=a633011057f643218e20293412f8108f&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=0c79e2ac1c3248618dfc1b9f7374a15a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:37.664705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:37.668199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d986388-51d3-499f-9b45-9673c5bf624c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.708359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f6fef-44aa-499c-b9d5-7c24deedf46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.709107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f6fef-44aa-499c-b9d5-7c24deedf46d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.709390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f6fef-44aa-499c-b9d5-7c24deedf46d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.709660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f6fef-44aa-499c-b9d5-7c24deedf46d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.710473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f6fef-44aa-499c-b9d5-7c24deedf46d None admin] RBAC: Adding query filter params (interface=admin, service_id=899b3e42713c4229a58c39a7dcfb5987, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:37.710783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f6fef-44aa-499c-b9d5-7c24deedf46d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.712204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f6fef-44aa-499c-b9d5-7c24deedf46d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.723322 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 496/995] 10.222.0.49 () {56 vars in 1249 bytes} [Tue Jun 28 11:56:37 2022] GET /identity/v3/endpoints?service_id=899b3e42713c4229a58c39a7dcfb5987&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:37.724668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91e1b-48d8-4b55-8aff-a980dbe9d2ba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:37.813011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:37.832348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb91e1b-48d8-4b55-8aff-a980dbe9d2ba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:37.867654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c19aff-60e2-4d8a-a8b1-84887e6281e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:37.868459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c19aff-60e2-4d8a-a8b1-84887e6281e3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:37.868847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c19aff-60e2-4d8a-a8b1-84887e6281e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:37.869221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c19aff-60e2-4d8a-a8b1-84887e6281e3 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:37.870001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c19aff-60e2-4d8a-a8b1-84887e6281e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:37.872712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c19aff-60e2-4d8a-a8b1-84887e6281e3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:37.883963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 500/996] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Jun 28 11:56:37 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 11:56:39.466785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e693-a1fa-4994-b6d2-4056ebee9cb9 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:39.467339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e693-a1fa-4994-b6d2-4056ebee9cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:39.467339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265e693-a1fa-4994-b6d2-4056ebee9cb9 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:39.468875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 497/997] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:39.474487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dd60f-8cdc-4421-b32a-e34542211aaa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:39.474886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dd60f-8cdc-4421-b32a-e34542211aaa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:39.475316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dd60f-8cdc-4421-b32a-e34542211aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:39.492517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af1dd60f-8cdc-4421-b32a-e34542211aaa None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:39.493696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af1dd60f-8cdc-4421-b32a-e34542211aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:39.570517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 501/998] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:39.593208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265e693-a1fa-4994-b6d2-4056ebee9cb9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:39.673561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a1ba7-037d-467d-8300-1fdfef599004 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:39.674205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a1ba7-037d-467d-8300-1fdfef599004 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:39.674205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a1ba7-037d-467d-8300-1fdfef599004 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:39.675691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 502/999] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:39.680510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58f84f-72a6-4199-adb5-4d0ea49e531c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:39.680799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58f84f-72a6-4199-adb5-4d0ea49e531c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:39.681084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58f84f-72a6-4199-adb5-4d0ea49e531c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:39.698239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cd58f84f-72a6-4199-adb5-4d0ea49e531c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:39.699413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cd58f84f-72a6-4199-adb5-4d0ea49e531c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:39.700225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265e693-a1fa-4994-b6d2-4056ebee9cb9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:39.736314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965bd77-a69c-4ce4-989e-57430beb62d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:39.737034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965bd77-a69c-4ce4-989e-57430beb62d9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:39.737316 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965bd77-a69c-4ce4-989e-57430beb62d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:39.737600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965bd77-a69c-4ce4-989e-57430beb62d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:39.738230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965bd77-a69c-4ce4-989e-57430beb62d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:39.739605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965bd77-a69c-4ce4-989e-57430beb62d9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e965bd77-a69c-4ce4-989e-57430beb62d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:39.751269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:39.752312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:39.753168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 498/1000] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:39.758645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965bd77-a69c-4ce4-989e-57430beb62d9 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:39.783915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 503/1001] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:39.787267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:39.801210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58f84f-72a6-4199-adb5-4d0ea49e531c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:39.804417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:39.862556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965bd77-a69c-4ce4-989e-57430beb62d9 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:39.899676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea97b0-ca7f-485f-8196-a4bb86dd1cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:39.900380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea97b0-ca7f-485f-8196-a4bb86dd1cec None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:39.900669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea97b0-ca7f-485f-8196-a4bb86dd1cec None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:39.900955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea97b0-ca7f-485f-8196-a4bb86dd1cec None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:39.901728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea97b0-ca7f-485f-8196-a4bb86dd1cec None admin] RBAC: Adding query filter params (name=compute) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:39.902044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea97b0-ca7f-485f-8196-a4bb86dd1cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:39.903468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea97b0-ca7f-485f-8196-a4bb86dd1cec None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:39.905141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58f84f-72a6-4199-adb5-4d0ea49e531c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:39.908946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 499/1002] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:39.910424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c84705-3055-47e1-b639-a841d3833099 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:39.910763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c84705-3055-47e1-b639-a841d3833099 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:39.911126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c84705-3055-47e1-b639-a841d3833099 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:39.912462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 500/1003] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:39.915462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c84705-3055-47e1-b639-a841d3833099 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:39.940273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db69e-8e50-4727-817e-be7df2cf339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:39.941063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db69e-8e50-4727-817e-be7df2cf339d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:39.941347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db69e-8e50-4727-817e-be7df2cf339d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:39.941627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db69e-8e50-4727-817e-be7df2cf339d None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:39.942278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db69e-8e50-4727-817e-be7df2cf339d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:39.943647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db69e-8e50-4727-817e-be7df2cf339d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5b9db69e-8e50-4727-817e-be7df2cf339d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:39.955416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:39.956543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:39.957393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 504/1004] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Jun 28 11:56:39 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:39.958190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed23c-6dbd-4ce9-ae1d-1ffe8a4bda26 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:39.958190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed23c-6dbd-4ce9-ae1d-1ffe8a4bda26 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:39.958325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed23c-6dbd-4ce9-ae1d-1ffe8a4bda26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:39.974127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-30fed23c-6dbd-4ce9-ae1d-1ffe8a4bda26 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:39.975562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-30fed23c-6dbd-4ce9-ae1d-1ffe8a4bda26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:40.011169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:40.020508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c84705-3055-47e1-b639-a841d3833099 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:40.036654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:40.041734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 505/1005] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:40.042524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed23c-6dbd-4ce9-ae1d-1ffe8a4bda26 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:40.059052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4ad49-f3e7-43eb-98e2-195cc78b254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:40.059813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ad49-f3e7-43eb-98e2-195cc78b254a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:40.060149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ad49-f3e7-43eb-98e2-195cc78b254a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:40.060597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ad49-f3e7-43eb-98e2-195cc78b254a None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:40.061189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4ad49-f3e7-43eb-98e2-195cc78b254a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:40.061497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4ad49-f3e7-43eb-98e2-195cc78b254a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:40.062873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4ad49-f3e7-43eb-98e2-195cc78b254a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:40.068224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 501/1006] 10.222.0.49 () {56 vars in 1112 bytes} [Tue Jun 28 11:56:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:40.068844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4ad49-f3e7-43eb-98e2-195cc78b254a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:40.139820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed23c-6dbd-4ce9-ae1d-1ffe8a4bda26 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:40.168116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4ad49-f3e7-43eb-98e2-195cc78b254a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:40.173669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b819bb-1b3e-46d5-9a1e-9e1204f8e251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:40.174486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b819bb-1b3e-46d5-9a1e-9e1204f8e251 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:40.174770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b819bb-1b3e-46d5-9a1e-9e1204f8e251 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:40.175043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b819bb-1b3e-46d5-9a1e-9e1204f8e251 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:40.175754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b819bb-1b3e-46d5-9a1e-9e1204f8e251 None admin] RBAC: Adding query filter params (name=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:40.176092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b819bb-1b3e-46d5-9a1e-9e1204f8e251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:40.177452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b819bb-1b3e-46d5-9a1e-9e1204f8e251 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:40.182435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 506/1007] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:40.183026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b819bb-1b3e-46d5-9a1e-9e1204f8e251 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:40.203940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892052f-77a3-465e-9f6a-86f747897cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:40.204795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892052f-77a3-465e-9f6a-86f747897cab None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:40.205098 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892052f-77a3-465e-9f6a-86f747897cab None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:40.205338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892052f-77a3-465e-9f6a-86f747897cab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:40.205985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892052f-77a3-465e-9f6a-86f747897cab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:40.207342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892052f-77a3-465e-9f6a-86f747897cab None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8892052f-77a3-465e-9f6a-86f747897cab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:40.219080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:40.220823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 11:56:40.221737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:40.224036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 502/1008] 10.222.0.49 () {56 vars in 1126 bytes} [Tue Jun 28 11:56:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:40.225209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892052f-77a3-465e-9f6a-86f747897cab None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:40.244160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:40.247792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:40.280985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b819bb-1b3e-46d5-9a1e-9e1204f8e251 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:40.316410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570cb3d-5d33-40d9-9759-b8578a7dfd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:40.317076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570cb3d-5d33-40d9-9759-b8578a7dfd11 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:40.317360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570cb3d-5d33-40d9-9759-b8578a7dfd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:40.317641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570cb3d-5d33-40d9-9759-b8578a7dfd11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:40.318388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570cb3d-5d33-40d9-9759-b8578a7dfd11 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:40.319754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570cb3d-5d33-40d9-9759-b8578a7dfd11 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:40.324205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892052f-77a3-465e-9f6a-86f747897cab None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:40.357013 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035d1a8-9a78-4fb4-b1ea-45b6e48e26b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:40.357664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035d1a8-9a78-4fb4-b1ea-45b6e48e26b7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:40.357946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035d1a8-9a78-4fb4-b1ea-45b6e48e26b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:40.358250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035d1a8-9a78-4fb4-b1ea-45b6e48e26b7 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:40.358948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035d1a8-9a78-4fb4-b1ea-45b6e48e26b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:40.359253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035d1a8-9a78-4fb4-b1ea-45b6e48e26b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:40.361356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035d1a8-9a78-4fb4-b1ea-45b6e48e26b7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:40.365834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 503/1009] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:40.366615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035d1a8-9a78-4fb4-b1ea-45b6e48e26b7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:40.390344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 507/1010] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Jun 28 11:56:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:40.481192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:40.500556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035d1a8-9a78-4fb4-b1ea-45b6e48e26b7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:40.559379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b424f-ed06-432d-996e-cb67ecda63d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:40.560038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b424f-ed06-432d-996e-cb67ecda63d8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:40.560321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b424f-ed06-432d-996e-cb67ecda63d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:40.560594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b424f-ed06-432d-996e-cb67ecda63d8 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:40.561300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b424f-ed06-432d-996e-cb67ecda63d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:40.561603 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b424f-ed06-432d-996e-cb67ecda63d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:40.563025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b424f-ed06-432d-996e-cb67ecda63d8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:40.571254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 504/1011] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:40.576803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570cb3d-5d33-40d9-9759-b8578a7dfd11 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:40.692518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570cb3d-5d33-40d9-9759-b8578a7dfd11 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:40.711771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:40.730260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b97703-67e1-45be-a574-e5443b372c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:40.730936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97703-67e1-45be-a574-e5443b372c0d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:40.731248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97703-67e1-45be-a574-e5443b372c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:40.731528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97703-67e1-45be-a574-e5443b372c0d None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:40.732338 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b97703-67e1-45be-a574-e5443b372c0d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:40.732651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b97703-67e1-45be-a574-e5443b372c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:40.734028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b97703-67e1-45be-a574-e5443b372c0d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:40.744718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 508/1012] 10.222.0.49 () {56 vars in 1122 bytes} [Tue Jun 28 11:56:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:40.745939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b424f-ed06-432d-996e-cb67ecda63d8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:40.854498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b424f-ed06-432d-996e-cb67ecda63d8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:40.888593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b795c-ece0-485b-a734-bc125e31ffd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:40.889253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b795c-ece0-485b-a734-bc125e31ffd5 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:40.889537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b795c-ece0-485b-a734-bc125e31ffd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:40.889813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b795c-ece0-485b-a734-bc125e31ffd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:40.890563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b795c-ece0-485b-a734-bc125e31ffd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:40.892542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b795c-ece0-485b-a734-bc125e31ffd5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:40.961227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 505/1013] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Jun 28 11:56:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:42.500109 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041df94-fbc0-4f53-a35f-4410b8182776 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:42.500636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041df94-fbc0-4f53-a35f-4410b8182776 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:42.500716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041df94-fbc0-4f53-a35f-4410b8182776 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:42.505657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 509/1014] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:42.508594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a942a-b07b-4c47-857d-50d4ad3e9eac None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:42.509024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a942a-b07b-4c47-857d-50d4ad3e9eac None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:42.509191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a942a-b07b-4c47-857d-50d4ad3e9eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:42.516231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:42.528287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9b0a942a-b07b-4c47-857d-50d4ad3e9eac None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:42.529510 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9b0a942a-b07b-4c47-857d-50d4ad3e9eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:42.576346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c081-493a-4359-b0ea-3179662d9dee None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:42.576639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c081-493a-4359-b0ea-3179662d9dee None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:42.576904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2c081-493a-4359-b0ea-3179662d9dee None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:42.578393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 510/1015] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:42.584005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef3a2f-95c1-4a19-9386-64c3c8bd019c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:42.584298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef3a2f-95c1-4a19-9386-64c3c8bd019c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:42.584874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef3a2f-95c1-4a19-9386-64c3c8bd019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:42.604995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-54ef3a2f-95c1-4a19-9386-64c3c8bd019c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:42.606264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-54ef3a2f-95c1-4a19-9386-64c3c8bd019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:42.608986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 506/1016] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:42 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:42.633533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a942a-b07b-4c47-857d-50d4ad3e9eac None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:42.679361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 511/1017] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:42 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:42.702350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef3a2f-95c1-4a19-9386-64c3c8bd019c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:42.740069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a942a-b07b-4c47-857d-50d4ad3e9eac None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:42.772182 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:42.778199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d7fb0-8d1f-4de0-8b9f-a8a816af85f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:42.778863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d7fb0-8d1f-4de0-8b9f-a8a816af85f9 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:42.779142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d7fb0-8d1f-4de0-8b9f-a8a816af85f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:42.779502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d7fb0-8d1f-4de0-8b9f-a8a816af85f9 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:42.780164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d7fb0-8d1f-4de0-8b9f-a8a816af85f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:42.785936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d7fb0-8d1f-4de0-8b9f-a8a816af85f9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:42.810146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef3a2f-95c1-4a19-9386-64c3c8bd019c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:42.823051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:42.844009 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7e216-2a9d-4f94-abf2-49371fbf1da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:42.845459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e216-2a9d-4f94-abf2-49371fbf1da9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:42.845747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e216-2a9d-4f94-abf2-49371fbf1da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:42.846028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e216-2a9d-4f94-abf2-49371fbf1da9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:42.856620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7e216-2a9d-4f94-abf2-49371fbf1da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-50a7e216-2a9d-4f94-abf2-49371fbf1da9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:42.865031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:42.865995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:42.866842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 512/1018] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Jun 28 11:56:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:42.871899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7e216-2a9d-4f94-abf2-49371fbf1da9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:42.892780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 507/1019] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:56:42 2022] POST /identity/v3/services => generated 242 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 11:56:42.983454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7e216-2a9d-4f94-abf2-49371fbf1da9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:43.008898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa83ee-c38f-4023-985d-ad2329a935c1 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.009163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa83ee-c38f-4023-985d-ad2329a935c1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.009446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa83ee-c38f-4023-985d-ad2329a935c1 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.011024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 508/1020] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:43.017152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcf86-0114-4c16-a2a7-d61f4372a93b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.017464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcf86-0114-4c16-a2a7-d61f4372a93b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.017729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dcf86-0114-4c16-a2a7-d61f4372a93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.030907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b7ac6-a7f0-49a2-ad31-f11ec20c813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:43.031505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7ac6-a7f0-49a2-ad31-f11ec20c813d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.031794 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7ac6-a7f0-49a2-ad31-f11ec20c813d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.032644 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b7ac6-a7f0-49a2-ad31-f11ec20c813d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.033609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b7ac6-a7f0-49a2-ad31-f11ec20c813d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:43.033928 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b7ac6-a7f0-49a2-ad31-f11ec20c813d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:43.035323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b7ac6-a7f0-49a2-ad31-f11ec20c813d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:43.035554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7e8dcf86-0114-4c16-a2a7-d61f4372a93b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:43.036858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7e8dcf86-0114-4c16-a2a7-d61f4372a93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:43.045029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 513/1021] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Jun 28 11:56:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:43.050900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b7ac6-a7f0-49a2-ad31-f11ec20c813d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:43.089548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:43.115514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 509/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:43.138734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dcf86-0114-4c16-a2a7-d61f4372a93b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:43.162822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b7ac6-a7f0-49a2-ad31-f11ec20c813d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:43.200203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f517b3-3cd8-4bee-9361-7c30c2677a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:43.200998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f517b3-3cd8-4bee-9361-7c30c2677a53 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.201285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f517b3-3cd8-4bee-9361-7c30c2677a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.201679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f517b3-3cd8-4bee-9361-7c30c2677a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.213194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f517b3-3cd8-4bee-9361-7c30c2677a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:43.214707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f517b3-3cd8-4bee-9361-7c30c2677a53 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e4f517b3-3cd8-4bee-9361-7c30c2677a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:43.234626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:43.235717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:43.236816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:43.236816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:43.236816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:43.236816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:43.236816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 514/1023] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:43.241144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dcf86-0114-4c16-a2a7-d61f4372a93b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:43.241783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f517b3-3cd8-4bee-9361-7c30c2677a53 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:43.264126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:43.278597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90340112-2a36-44b6-bbbc-2944d34a035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:43.279454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90340112-2a36-44b6-bbbc-2944d34a035f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.279752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90340112-2a36-44b6-bbbc-2944d34a035f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.280059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90340112-2a36-44b6-bbbc-2944d34a035f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.281304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90340112-2a36-44b6-bbbc-2944d34a035f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:43.282943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90340112-2a36-44b6-bbbc-2944d34a035f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:43.284683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 510/1024] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:43.290543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90340112-2a36-44b6-bbbc-2944d34a035f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:43.335798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:43.354931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f517b3-3cd8-4bee-9361-7c30c2677a53 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:43.391238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d3c7c-6bbf-4310-b1d5-6ae65a4972c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:43.391963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d3c7c-6bbf-4310-b1d5-6ae65a4972c3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.392257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d3c7c-6bbf-4310-b1d5-6ae65a4972c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.392540 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d3c7c-6bbf-4310-b1d5-6ae65a4972c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.393269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d3c7c-6bbf-4310-b1d5-6ae65a4972c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:43.393688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d3c7c-6bbf-4310-b1d5-6ae65a4972c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:43.395066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d3c7c-6bbf-4310-b1d5-6ae65a4972c3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:43.396468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90340112-2a36-44b6-bbbc-2944d34a035f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:43.406552 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 515/1025] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:43.411994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d3c7c-6bbf-4310-b1d5-6ae65a4972c3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:43.434718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36532f-95d5-4a0f-b850-f141016c7e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:43.435540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36532f-95d5-4a0f-b850-f141016c7e9c None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.435827 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36532f-95d5-4a0f-b850-f141016c7e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.436150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36532f-95d5-4a0f-b850-f141016c7e9c None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.436865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36532f-95d5-4a0f-b850-f141016c7e9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:43.438915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36532f-95d5-4a0f-b850-f141016c7e9c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:43.514453 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d3c7c-6bbf-4310-b1d5-6ae65a4972c3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:43.548879 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 511/1026] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:56:43 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 11:56:43.550886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591b3f-a4e1-4225-8acf-f1e68b30c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:43.551704 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591b3f-a4e1-4225-8acf-f1e68b30c1ee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.552038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591b3f-a4e1-4225-8acf-f1e68b30c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.552385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591b3f-a4e1-4225-8acf-f1e68b30c1ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.561508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b591b3f-a4e1-4225-8acf-f1e68b30c1ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:43.563834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b591b3f-a4e1-4225-8acf-f1e68b30c1ee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6b591b3f-a4e1-4225-8acf-f1e68b30c1ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:43.579967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:43.581005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:43.581971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 516/1027] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Jun 28 11:56:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:43.587246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36532f-95d5-4a0f-b850-f141016c7e9c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:43.639502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:43.704698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36532f-95d5-4a0f-b850-f141016c7e9c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:43.739976 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412236a9-b331-49a5-bf30-5f7fbbb51a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:43.740652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412236a9-b331-49a5-bf30-5f7fbbb51a1c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.740933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412236a9-b331-49a5-bf30-5f7fbbb51a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.741206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412236a9-b331-49a5-bf30-5f7fbbb51a1c None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.742035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412236a9-b331-49a5-bf30-5f7fbbb51a1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:43.742346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412236a9-b331-49a5-bf30-5f7fbbb51a1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:43.743773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412236a9-b331-49a5-bf30-5f7fbbb51a1c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:43.761888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 512/1028] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Jun 28 11:56:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:43.767624 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591b3f-a4e1-4225-8acf-f1e68b30c1ee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:43.770573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:43.872445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591b3f-a4e1-4225-8acf-f1e68b30c1ee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:43.908226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ba68-ce14-4d73-822f-efab33222fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:43.909176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ba68-ce14-4d73-822f-efab33222fbe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:43.909676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ba68-ce14-4d73-822f-efab33222fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:43.910141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ba68-ce14-4d73-822f-efab33222fbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:43.980465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ba68-ce14-4d73-822f-efab33222fbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:43.982236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ba68-ce14-4d73-822f-efab33222fbe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:43.984338 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:44.094125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 517/1029] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 11:56:44.096507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412236a9-b331-49a5-bf30-5f7fbbb51a1c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:44.206159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:44.210436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412236a9-b331-49a5-bf30-5f7fbbb51a1c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:44.245868 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72361b-0335-4ba8-8654-42e3fb54d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:44.246663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72361b-0335-4ba8-8654-42e3fb54d73c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:44.246948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72361b-0335-4ba8-8654-42e3fb54d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:44.247224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72361b-0335-4ba8-8654-42e3fb54d73c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:44.258009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72361b-0335-4ba8-8654-42e3fb54d73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:44.259468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72361b-0335-4ba8-8654-42e3fb54d73c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3d72361b-0335-4ba8-8654-42e3fb54d73c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:44.278337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:44.279217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:44.285449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:44.285449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:44.285449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:44.285449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:44.285449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 513/1030] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:44.287272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ba68-ce14-4d73-822f-efab33222fbe None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:44.389967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ba68-ce14-4d73-822f-efab33222fbe None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:44.392535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:44.427006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd8c6-8e4e-40f7-b317-7a175fe69fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:44.427677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd8c6-8e4e-40f7-b317-7a175fe69fbd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:44.428006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd8c6-8e4e-40f7-b317-7a175fe69fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:44.428291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bd8c6-8e4e-40f7-b317-7a175fe69fbd None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:44.429016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bd8c6-8e4e-40f7-b317-7a175fe69fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:44.429329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bd8c6-8e4e-40f7-b317-7a175fe69fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:44.430696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bd8c6-8e4e-40f7-b317-7a175fe69fbd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:44.446898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 518/1031] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:44.448471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72361b-0335-4ba8-8654-42e3fb54d73c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:44.559749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72361b-0335-4ba8-8654-42e3fb54d73c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:44.595054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2912700-d286-4911-a6e0-f9b6c0c3701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:44.595814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2912700-d286-4911-a6e0-f9b6c0c3701b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:44.596127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2912700-d286-4911-a6e0-f9b6c0c3701b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:44.596405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2912700-d286-4911-a6e0-f9b6c0c3701b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:44.603263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2912700-d286-4911-a6e0-f9b6c0c3701b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:44.604739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2912700-d286-4911-a6e0-f9b6c0c3701b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c2912700-d286-4911-a6e0-f9b6c0c3701b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:44.618668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:44.619683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:44.620999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:44.620999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:44.620999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:44.620999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:44.620999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:44.620999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:44.620999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:44.620999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:44.623980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 514/1032] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:44.626395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd8c6-8e4e-40f7-b317-7a175fe69fbd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:44.732187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bd8c6-8e4e-40f7-b317-7a175fe69fbd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:44.765949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4073947-e6f7-4615-95e0-206c4bd80b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:44.767237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4073947-e6f7-4615-95e0-206c4bd80b16 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:44.767608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4073947-e6f7-4615-95e0-206c4bd80b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:44.767907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4073947-e6f7-4615-95e0-206c4bd80b16 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:44.768702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4073947-e6f7-4615-95e0-206c4bd80b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:44.769015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4073947-e6f7-4615-95e0-206c4bd80b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:44.770452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4073947-e6f7-4615-95e0-206c4bd80b16 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:44.782729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 519/1033] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:44.788519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2912700-d286-4911-a6e0-f9b6c0c3701b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:44.801814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:44.893304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2912700-d286-4911-a6e0-f9b6c0c3701b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:44.926297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14039ce3-e0ef-49ba-b736-eb53199b90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:44.926958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14039ce3-e0ef-49ba-b736-eb53199b90c7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:44.927246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14039ce3-e0ef-49ba-b736-eb53199b90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:44.927517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14039ce3-e0ef-49ba-b736-eb53199b90c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:44.928379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14039ce3-e0ef-49ba-b736-eb53199b90c7 None admin] RBAC: Adding query filter params (role.id=0c79e2ac1c3248618dfc1b9f7374a15a, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=fbfe6b7a82f746169a39976be263aa29) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:44.928691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14039ce3-e0ef-49ba-b736-eb53199b90c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:44.930127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14039ce3-e0ef-49ba-b736-eb53199b90c7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:44.944145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 515/1034] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:44 2022] GET /identity/v3/role_assignments?user.id=fbfe6b7a82f746169a39976be263aa29&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=0c79e2ac1c3248618dfc1b9f7374a15a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:44.967654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c0b7a-d033-4d2f-9653-eb4443b6c46b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:44.967971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c0b7a-d033-4d2f-9653-eb4443b6c46b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:44.968247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c0b7a-d033-4d2f-9653-eb4443b6c46b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:44.969714 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 520/1035] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:44.975628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeab00-696b-4d80-a36d-cbfa875319f9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:44.975970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeab00-696b-4d80-a36d-cbfa875319f9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:44.976238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeab00-696b-4d80-a36d-cbfa875319f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:44.994446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-30eeab00-696b-4d80-a36d-cbfa875319f9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:44.995693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-30eeab00-696b-4d80-a36d-cbfa875319f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:45.076010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 516/1036] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:45.096300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c0b7a-d033-4d2f-9653-eb4443b6c46b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:45.122836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:45.208018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c0b7a-d033-4d2f-9653-eb4443b6c46b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:45.244219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bbced-758b-4b02-a014-f46407f8834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:45.245061 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bbced-758b-4b02-a014-f46407f8834e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:45.245349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bbced-758b-4b02-a014-f46407f8834e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:45.245621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bbced-758b-4b02-a014-f46407f8834e None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:45.246275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bbced-758b-4b02-a014-f46407f8834e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:45.247649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bbced-758b-4b02-a014-f46407f8834e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-733bbced-758b-4b02-a014-f46407f8834e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:45.260836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:45.261836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:45.262664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 521/1037] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Jun 28 11:56:45 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:45.270090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeab00-696b-4d80-a36d-cbfa875319f9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:45.273301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:45.373520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeab00-696b-4d80-a36d-cbfa875319f9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:45.410148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4eb3-d507-475a-a9c5-6ee41b00de7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:45.410824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4eb3-d507-475a-a9c5-6ee41b00de7a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:45.411108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4eb3-d507-475a-a9c5-6ee41b00de7a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:45.411440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4eb3-d507-475a-a9c5-6ee41b00de7a None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:45.412194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a4eb3-d507-475a-a9c5-6ee41b00de7a None admin] RBAC: Adding query filter params (name=image) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:45.412556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a4eb3-d507-475a-a9c5-6ee41b00de7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:45.413936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a4eb3-d507-475a-a9c5-6ee41b00de7a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:45.424139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 517/1038] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:45.425444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bbced-758b-4b02-a014-f46407f8834e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:45.516944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:45.532599 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bbced-758b-4b02-a014-f46407f8834e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:45.568169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e68f4-a4ec-4429-b2bf-ca96c716ff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:45.568840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e68f4-a4ec-4429-b2bf-ca96c716ff55 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:45.569125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e68f4-a4ec-4429-b2bf-ca96c716ff55 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:45.569404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e68f4-a4ec-4429-b2bf-ca96c716ff55 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:45.570112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e68f4-a4ec-4429-b2bf-ca96c716ff55 None admin] RBAC: Adding query filter params (type=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:45.570422 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e68f4-a4ec-4429-b2bf-ca96c716ff55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:45.571781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e68f4-a4ec-4429-b2bf-ca96c716ff55 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:45.582176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 522/1039] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:45.583724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4eb3-d507-475a-a9c5-6ee41b00de7a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:45.647465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30ced-86f8-4ced-a30b-fd8213f95e10 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:45.648006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30ced-86f8-4ced-a30b-fd8213f95e10 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:45.648006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30ced-86f8-4ced-a30b-fd8213f95e10 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:45.649349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 523/1040] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:45.653684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:45.654401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6117d-8cc2-4b9b-875b-19e6f1612584 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:45.654715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6117d-8cc2-4b9b-875b-19e6f1612584 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:45.654976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6117d-8cc2-4b9b-875b-19e6f1612584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:45.671842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-18a6117d-8cc2-4b9b-875b-19e6f1612584 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:45.673688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-18a6117d-8cc2-4b9b-875b-19e6f1612584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:45.690048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4eb3-d507-475a-a9c5-6ee41b00de7a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:45.738894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec402c0-e039-4814-a61b-0a455822d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:45.739561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec402c0-e039-4814-a61b-0a455822d5ee None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:45.739891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec402c0-e039-4814-a61b-0a455822d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:45.740156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec402c0-e039-4814-a61b-0a455822d5ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:45.740948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec402c0-e039-4814-a61b-0a455822d5ee None admin] RBAC: Adding query filter params (interface=public, service_id=86e46c7801d74662845e0e21b9c47a57, region_id=RegionOne) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:45.741263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec402c0-e039-4814-a61b-0a455822d5ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:45.742638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec402c0-e039-4814-a61b-0a455822d5ee None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:45.746078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 524/1041] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:45.753871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 518/1042] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Jun 28 11:56:45 2022] GET /identity/v3/endpoints?service_id=86e46c7801d74662845e0e21b9c47a57&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:45.755223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6117d-8cc2-4b9b-875b-19e6f1612584 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:45.770956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec402c0-e039-4814-a61b-0a455822d5ee None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:45.841257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:45.860918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6117d-8cc2-4b9b-875b-19e6f1612584 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:45.873842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec402c0-e039-4814-a61b-0a455822d5ee None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:45.895838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d1b5b-e95e-458e-93f1-60d9075931e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:45.896535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1b5b-e95e-458e-93f1-60d9075931e2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:45.896820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1b5b-e95e-458e-93f1-60d9075931e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:45.897095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1b5b-e95e-458e-93f1-60d9075931e2 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:45.897832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d1b5b-e95e-458e-93f1-60d9075931e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:45.899144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d1b5b-e95e-458e-93f1-60d9075931e2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:45.905846 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 525/1043] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Jun 28 11:56:45 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 11:56:45.921680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:45.927772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c6fca-1c85-4877-98eb-0e61c3b085cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:45.928698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c6fca-1c85-4877-98eb-0e61c3b085cc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:45.928895 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c6fca-1c85-4877-98eb-0e61c3b085cc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:45.929165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c6fca-1c85-4877-98eb-0e61c3b085cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:45.934949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c6fca-1c85-4877-98eb-0e61c3b085cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:45.934949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c6fca-1c85-4877-98eb-0e61c3b085cc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:45.934949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 519/1044] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:45.939865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d1b5b-e95e-458e-93f1-60d9075931e2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:46.053111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d1b5b-e95e-458e-93f1-60d9075931e2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:46.090031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ecf9-1eec-425c-978d-430a100bd512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:46.090726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ecf9-1eec-425c-978d-430a100bd512 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:46.091222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ecf9-1eec-425c-978d-430a100bd512 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:46.091222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ecf9-1eec-425c-978d-430a100bd512 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:46.095208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670ecf9-1eec-425c-978d-430a100bd512 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:46.095208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670ecf9-1eec-425c-978d-430a100bd512 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:46.193335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:46.199244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 526/1045] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:56:45 2022] POST /identity/v3/users => generated 285 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:46.976180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad363d-58b9-4c5a-8b8f-7d2cb5367307 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:46.976700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad363d-58b9-4c5a-8b8f-7d2cb5367307 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:46.976700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad363d-58b9-4c5a-8b8f-7d2cb5367307 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:46.978226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 520/1046] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:46.983188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4e24e-8b39-4ff8-8490-a4621eb2b3d1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:46.983581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4e24e-8b39-4ff8-8490-a4621eb2b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:46.983747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4e24e-8b39-4ff8-8490-a4621eb2b3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:47.001547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b2a4e24e-8b39-4ff8-8490-a4621eb2b3d1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:47.002734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b2a4e24e-8b39-4ff8-8490-a4621eb2b3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:47.073444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 527/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:47.096338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad363d-58b9-4c5a-8b8f-7d2cb5367307 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:47.218519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad363d-58b9-4c5a-8b8f-7d2cb5367307 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:47.253820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87bbb6-028a-4379-8fdf-14fdf740b136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:47.254553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87bbb6-028a-4379-8fdf-14fdf740b136 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:47.254832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87bbb6-028a-4379-8fdf-14fdf740b136 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:47.255104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87bbb6-028a-4379-8fdf-14fdf740b136 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:47.265211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87bbb6-028a-4379-8fdf-14fdf740b136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3b87bbb6-028a-4379-8fdf-14fdf740b136 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:47.273839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:47.274812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:47.275634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:47.277010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 521/1048] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Jun 28 11:56:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:47.281075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4e24e-8b39-4ff8-8490-a4621eb2b3d1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:47.382316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4e24e-8b39-4ff8-8490-a4621eb2b3d1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:47.413516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:47.419967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f63a5-86af-4da1-bc0d-4076aedcd7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:47.420642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f63a5-86af-4da1-bc0d-4076aedcd7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:47.420921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f63a5-86af-4da1-bc0d-4076aedcd7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:47.421191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f63a5-86af-4da1-bc0d-4076aedcd7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:47.435996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f63a5-86af-4da1-bc0d-4076aedcd7a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:47.435996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f63a5-86af-4da1-bc0d-4076aedcd7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:47.435996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f63a5-86af-4da1-bc0d-4076aedcd7a1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:47.435996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 528/1049] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Jun 28 11:56:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:47.438556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87bbb6-028a-4379-8fdf-14fdf740b136 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:47.500330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:47.547168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87bbb6-028a-4379-8fdf-14fdf740b136 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:47.582356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eb96d-fbd3-4a6f-8829-984e2a64c224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:47.583148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eb96d-fbd3-4a6f-8829-984e2a64c224 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:47.583429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eb96d-fbd3-4a6f-8829-984e2a64c224 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:47.583705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eb96d-fbd3-4a6f-8829-984e2a64c224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:47.594217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2eb96d-fbd3-4a6f-8829-984e2a64c224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:47.595702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2eb96d-fbd3-4a6f-8829-984e2a64c224 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8f2eb96d-fbd3-4a6f-8829-984e2a64c224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:47.612591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:47.613501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:47.614409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:47.614409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:47.614409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:47.614409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:47.615175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 522/1050] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:47.619400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f63a5-86af-4da1-bc0d-4076aedcd7a1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:47.726207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f63a5-86af-4da1-bc0d-4076aedcd7a1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:47.760501 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aff66-c6f8-49a6-9e8f-dc6b7d1da874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:47.761157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aff66-c6f8-49a6-9e8f-dc6b7d1da874 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:47.761438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aff66-c6f8-49a6-9e8f-dc6b7d1da874 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:47.761712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aff66-c6f8-49a6-9e8f-dc6b7d1da874 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:47.762428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78aff66-c6f8-49a6-9e8f-dc6b7d1da874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:47.762734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78aff66-c6f8-49a6-9e8f-dc6b7d1da874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:47.764127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78aff66-c6f8-49a6-9e8f-dc6b7d1da874 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:47.781167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 529/1051] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:47.782492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eb96d-fbd3-4a6f-8829-984e2a64c224 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:47.882361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eb96d-fbd3-4a6f-8829-984e2a64c224 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:47.895347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:47.916116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79e3b6-c232-4994-aa61-7eadcfc5b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:47.916903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79e3b6-c232-4994-aa61-7eadcfc5b6de None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:47.917224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79e3b6-c232-4994-aa61-7eadcfc5b6de None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:47.917493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79e3b6-c232-4994-aa61-7eadcfc5b6de None admin] PATH_INFO: `/v3/users/nova` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:47.926061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79e3b6-c232-4994-aa61-7eadcfc5b6de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:47.927508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79e3b6-c232-4994-aa61-7eadcfc5b6de None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8a79e3b6-c232-4994-aa61-7eadcfc5b6de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:47.942310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:47.943266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:47.944245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 523/1052] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Jun 28 11:56:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:47.950472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aff66-c6f8-49a6-9e8f-dc6b7d1da874 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.006699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:48.029538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c786a-6d16-4070-a06b-ac84bda0fcb6 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.030045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c786a-6d16-4070-a06b-ac84bda0fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.030122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c786a-6d16-4070-a06b-ac84bda0fcb6 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.031655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 524/1053] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:48.037300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d297c-6bee-4e1b-bce2-29658d17d9f5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.037594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d297c-6bee-4e1b-bce2-29658d17d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.037924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d297c-6bee-4e1b-bce2-29658d17d9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.055135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-304d297c-6bee-4e1b-bce2-29658d17d9f5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:48.056276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aff66-c6f8-49a6-9e8f-dc6b7d1da874 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.056523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-304d297c-6bee-4e1b-bce2-29658d17d9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:48.096600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19a7a0-bcd9-4285-962c-b52cd04f2fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.097520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a7a0-bcd9-4285-962c-b52cd04f2fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.097806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a7a0-bcd9-4285-962c-b52cd04f2fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.098083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a7a0-bcd9-4285-962c-b52cd04f2fe7 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.099342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a7a0-bcd9-4285-962c-b52cd04f2fe7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:48.099930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a7a0-bcd9-4285-962c-b52cd04f2fe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:48.101366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a7a0-bcd9-4285-962c-b52cd04f2fe7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:48.124354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 530/1054] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Jun 28 11:56:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:48.129232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 525/1055] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:48.133225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19a7a0-bcd9-4285-962c-b52cd04f2fe7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.152899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d297c-6bee-4e1b-bce2-29658d17d9f5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.241399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19a7a0-bcd9-4285-962c-b52cd04f2fe7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.252900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:48.260395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d297c-6bee-4e1b-bce2-29658d17d9f5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.261965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:48.277574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1ffdf-b4b9-43cf-bf78-ba2fc9a22d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.278373 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ffdf-b4b9-43cf-bf78-ba2fc9a22d82 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.278662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ffdf-b4b9-43cf-bf78-ba2fc9a22d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.278942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ffdf-b4b9-43cf-bf78-ba2fc9a22d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.294910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1ffdf-b4b9-43cf-bf78-ba2fc9a22d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:48.294910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1ffdf-b4b9-43cf-bf78-ba2fc9a22d82 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:48.298403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43325c6-d5f6-4c70-b863-41ef0394d888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.299202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43325c6-d5f6-4c70-b863-41ef0394d888 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.299486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43325c6-d5f6-4c70-b863-41ef0394d888 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.300092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43325c6-d5f6-4c70-b863-41ef0394d888 None admin] PATH_INFO: `/v3/services/image` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.300458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43325c6-d5f6-4c70-b863-41ef0394d888 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:48.301970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43325c6-d5f6-4c70-b863-41ef0394d888 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7bf1ffdf-b4b9-43cf-bf78-ba2fc9a22d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:48.311065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:48.311983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:48.313390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:48.313390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:48.313390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:48.313390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-f43325c6-d5f6-4c70-b863-41ef0394d888 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:48.313829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:48.315281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 11:56:48.316771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:48.318553 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 531/1056] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:48.318553 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1ffdf-b4b9-43cf-bf78-ba2fc9a22d82 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.319799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 526/1057] 10.222.0.49 () {56 vars in 1105 bytes} [Tue Jun 28 11:56:48 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:48.321192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43325c6-d5f6-4c70-b863-41ef0394d888 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.422043 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43325c6-d5f6-4c70-b863-41ef0394d888 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.423126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1ffdf-b4b9-43cf-bf78-ba2fc9a22d82 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.455602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa364713-c0c3-4b03-af0d-e84568459cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.456290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa364713-c0c3-4b03-af0d-e84568459cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.456573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa364713-c0c3-4b03-af0d-e84568459cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.456846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa364713-c0c3-4b03-af0d-e84568459cd1 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.457553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa364713-c0c3-4b03-af0d-e84568459cd1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:48.457957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa364713-c0c3-4b03-af0d-e84568459cd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:48.459262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa364713-c0c3-4b03-af0d-e84568459cd1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:48.459669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cef53b-c7c9-4b17-94f8-746278ab1ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.461573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef53b-c7c9-4b17-94f8-746278ab1ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.461858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef53b-c7c9-4b17-94f8-746278ab1ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.462134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef53b-c7c9-4b17-94f8-746278ab1ae6 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.463367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cef53b-c7c9-4b17-94f8-746278ab1ae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:48.463684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cef53b-c7c9-4b17-94f8-746278ab1ae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:48.464294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 527/1058] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:48.465525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcce2d-78b6-444b-afa2-10badc9fdd68 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.465811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcce2d-78b6-444b-afa2-10badc9fdd68 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.466086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcce2d-78b6-444b-afa2-10badc9fdd68 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.466829 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cef53b-c7c9-4b17-94f8-746278ab1ae6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:48.467519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 528/1059] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:48.472425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcce2d-78b6-444b-afa2-10badc9fdd68 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.484205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 532/1060] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:48.486918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600d865-2cc7-42ad-88f0-ff932c037d78 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.487214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600d865-2cc7-42ad-88f0-ff932c037d78 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.487502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600d865-2cc7-42ad-88f0-ff932c037d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.504812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6600d865-2cc7-42ad-88f0-ff932c037d78 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:48.506016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6600d865-2cc7-42ad-88f0-ff932c037d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:48.509814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:48.524965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:48.575361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 533/1061] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:48.576317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600d865-2cc7-42ad-88f0-ff932c037d78 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.584780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcce2d-78b6-444b-afa2-10badc9fdd68 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.622558 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d12f0-bb0a-427a-90ab-949601663e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.623226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d12f0-bb0a-427a-90ab-949601663e77 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.623511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d12f0-bb0a-427a-90ab-949601663e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.623791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d12f0-bb0a-427a-90ab-949601663e77 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.624563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d12f0-bb0a-427a-90ab-949601663e77 None admin] RBAC: Adding query filter params (type=image) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:48.624875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d12f0-bb0a-427a-90ab-949601663e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:48.627408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d12f0-bb0a-427a-90ab-949601663e77 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:48.632229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 529/1062] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:48.637037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d12f0-bb0a-427a-90ab-949601663e77 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.677792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600d865-2cc7-42ad-88f0-ff932c037d78 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.711771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c559-f999-4e9f-a7ae-a9209e3ce68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.712595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c559-f999-4e9f-a7ae-a9209e3ce68c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.712880 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c559-f999-4e9f-a7ae-a9209e3ce68c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.713158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c559-f999-4e9f-a7ae-a9209e3ce68c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.721124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c559-f999-4e9f-a7ae-a9209e3ce68c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:48.722578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c559-f999-4e9f-a7ae-a9209e3ce68c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:48.728147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:48.734494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d12f0-bb0a-427a-90ab-949601663e77 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a9a6c559-f999-4e9f-a7ae-a9209e3ce68c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:48.738077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:48.739472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 534/1063] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:48.740420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c559-f999-4e9f-a7ae-a9209e3ce68c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.756980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:48.768476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde92cf4-ab16-4df6-a843-9200f4b8e9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.769268 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde92cf4-ab16-4df6-a843-9200f4b8e9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.769547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde92cf4-ab16-4df6-a843-9200f4b8e9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.769820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde92cf4-ab16-4df6-a843-9200f4b8e9e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.779629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde92cf4-ab16-4df6-a843-9200f4b8e9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-cde92cf4-ab16-4df6-a843-9200f4b8e9e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:48.787259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:48.788428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 530/1064] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:48.789264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde92cf4-ab16-4df6-a843-9200f4b8e9e0 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.848553 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c559-f999-4e9f-a7ae-a9209e3ce68c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.884076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fafa-882c-461c-8f8c-0a17b95725e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.884729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fafa-882c-461c-8f8c-0a17b95725e4 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.885014 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fafa-882c-461c-8f8c-0a17b95725e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.885295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77fafa-882c-461c-8f8c-0a17b95725e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.886044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77fafa-882c-461c-8f8c-0a17b95725e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:48.887413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77fafa-882c-461c-8f8c-0a17b95725e4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:48.894693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde92cf4-ab16-4df6-a843-9200f4b8e9e0 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:48.927781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca91f5b-9294-4fc3-9669-f2320074cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:48.928464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca91f5b-9294-4fc3-9669-f2320074cced None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:48.928753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca91f5b-9294-4fc3-9669-f2320074cced None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:48.929030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca91f5b-9294-4fc3-9669-f2320074cced None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:48.929820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca91f5b-9294-4fc3-9669-f2320074cced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:48.930133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca91f5b-9294-4fc3-9669-f2320074cced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:48.931566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca91f5b-9294-4fc3-9669-f2320074cced None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:48.943922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 531/1065] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:48.944755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca91f5b-9294-4fc3-9669-f2320074cced None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:48.959591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:48.992964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 535/1066] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Jun 28 11:56:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:56:48.994078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fafa-882c-461c-8f8c-0a17b95725e4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:49.054435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca91f5b-9294-4fc3-9669-f2320074cced None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:49.087673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:49.101509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf44376-4c3b-44de-91b6-2c65719da34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:49.102103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf44376-4c3b-44de-91b6-2c65719da34e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:49.102384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf44376-4c3b-44de-91b6-2c65719da34e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:49.102658 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf44376-4c3b-44de-91b6-2c65719da34e None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:49.103417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf44376-4c3b-44de-91b6-2c65719da34e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:49.103719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf44376-4c3b-44de-91b6-2c65719da34e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:49.105161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf44376-4c3b-44de-91b6-2c65719da34e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:49.114953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 532/1067] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:49.120869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf44376-4c3b-44de-91b6-2c65719da34e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:49.136408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77fafa-882c-461c-8f8c-0a17b95725e4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:49.178651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e1f4-5d99-494a-be42-d5d7a88b2f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:49.179550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e1f4-5d99-494a-be42-d5d7a88b2f6d None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:49.179828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e1f4-5d99-494a-be42-d5d7a88b2f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:49.180589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2e1f4-5d99-494a-be42-d5d7a88b2f6d None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/fbfe6b7a82f746169a39976be263aa29/roles/0c79e2ac1c3248618dfc1b9f7374a15a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:49.184711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2e1f4-5d99-494a-be42-d5d7a88b2f6d None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=fbfe6b7a82f746169a39976be263aa29, role_id=0c79e2ac1c3248618dfc1b9f7374a15a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:49.186643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2e1f4-5d99-494a-be42-d5d7a88b2f6d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:49.199838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:49.229323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf44376-4c3b-44de-91b6-2c65719da34e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:49.261771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9670670-0fe6-4435-91d4-a52272ee7f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:49.262646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9670670-0fe6-4435-91d4-a52272ee7f89 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:49.262924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9670670-0fe6-4435-91d4-a52272ee7f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:49.263194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9670670-0fe6-4435-91d4-a52272ee7f89 None admin] PATH_INFO: `/v3/users/9a6ed104a77e4d97bcf90128129548b9` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:49.272238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 536/1068] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:56:48 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/fbfe6b7a82f746169a39976be263aa29/roles/0c79e2ac1c3248618dfc1b9f7374a15a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:56:49.286320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9670670-0fe6-4435-91d4-a52272ee7f89 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6ed104a77e4d97bcf90128129548b9)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:49.287806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9670670-0fe6-4435-91d4-a52272ee7f89 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:49.290079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 533/1069] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:56:49 2022] GET /identity/v3/users/9a6ed104a77e4d97bcf90128129548b9 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:49.296095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e1f4-5d99-494a-be42-d5d7a88b2f6d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:49.409612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2e1f4-5d99-494a-be42-d5d7a88b2f6d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:49.442859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:49.452273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c94b1-d938-49a0-8f7e-1c3647a68468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:49.452935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c94b1-d938-49a0-8f7e-1c3647a68468 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:49.453216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c94b1-d938-49a0-8f7e-1c3647a68468 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:49.453486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c94b1-d938-49a0-8f7e-1c3647a68468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:49.569839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c94b1-d938-49a0-8f7e-1c3647a68468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:49.571433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c94b1-d938-49a0-8f7e-1c3647a68468 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:49.676420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 537/1070] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:49.677630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9670670-0fe6-4435-91d4-a52272ee7f89 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:49.780792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9670670-0fe6-4435-91d4-a52272ee7f89 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:49.808662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:49.815583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bb160-c570-41fe-9096-8ebd6881211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:49.820410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bb160-c570-41fe-9096-8ebd6881211a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:49.820410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bb160-c570-41fe-9096-8ebd6881211a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:49.820410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bb160-c570-41fe-9096-8ebd6881211a None admin] PATH_INFO: `/v3/projects/b787da378c1748e0811386067d159b10` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:49.820410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bb160-c570-41fe-9096-8ebd6881211a None admin] RBAC: Authorizing `identity:get_project(project_id=b787da378c1748e0811386067d159b10)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:49.820410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bb160-c570-41fe-9096-8ebd6881211a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:49.826843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 534/1071] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:56:49 2022] GET /identity/v3/projects/b787da378c1748e0811386067d159b10 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:49.827815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c94b1-d938-49a0-8f7e-1c3647a68468 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:49.856185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:49.929812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c94b1-d938-49a0-8f7e-1c3647a68468 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:49.963945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aa121-82bc-48a6-8615-92fd7cadf815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:49.964682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aa121-82bc-48a6-8615-92fd7cadf815 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:49.965031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aa121-82bc-48a6-8615-92fd7cadf815 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:49.965373 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aa121-82bc-48a6-8615-92fd7cadf815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:49.966272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aa121-82bc-48a6-8615-92fd7cadf815 None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=b787da378c1748e0811386067d159b10, user.id=9a6ed104a77e4d97bcf90128129548b9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:49.966654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aa121-82bc-48a6-8615-92fd7cadf815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:49.968159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aa121-82bc-48a6-8615-92fd7cadf815 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:49.979908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 538/1072] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:49 2022] GET /identity/v3/role_assignments?user.id=9a6ed104a77e4d97bcf90128129548b9&scope.project.id=b787da378c1748e0811386067d159b10&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:51.077618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048956-f3c5-423d-88a4-490866e8d08a None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.078169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048956-f3c5-423d-88a4-490866e8d08a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.078169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef048956-f3c5-423d-88a4-490866e8d08a None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.079778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 535/1073] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:51.084792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61d2d0-b397-42de-a194-a5d4fb8d42d7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.085180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61d2d0-b397-42de-a194-a5d4fb8d42d7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.085341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61d2d0-b397-42de-a194-a5d4fb8d42d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.102469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2f61d2d0-b397-42de-a194-a5d4fb8d42d7 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:51.103656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2f61d2d0-b397-42de-a194-a5d4fb8d42d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:51.170823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 539/1074] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:51.192774 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef048956-f3c5-423d-88a4-490866e8d08a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:51.294230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef048956-f3c5-423d-88a4-490866e8d08a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:51.327848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddd84b-8119-48cc-bbf1-b9489afe0b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:51.328473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddd84b-8119-48cc-bbf1-b9489afe0b3c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.329280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275fd2-f846-40b2-ad2d-b43ed64d6761 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.329443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddd84b-8119-48cc-bbf1-b9489afe0b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.329693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddd84b-8119-48cc-bbf1-b9489afe0b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.329798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275fd2-f846-40b2-ad2d-b43ed64d6761 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.329994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47275fd2-f846-40b2-ad2d-b43ed64d6761 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.331612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 540/1075] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:56:51.336302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff3802-029b-4a4b-8753-3fc680e61b7a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.336594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff3802-029b-4a4b-8753-3fc680e61b7a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.336876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff3802-029b-4a4b-8753-3fc680e61b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.353864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3eff3802-029b-4a4b-8753-3fc680e61b7a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:51.355047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3eff3802-029b-4a4b-8753-3fc680e61b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:51.371522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:51.404468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:51.408239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddd84b-8119-48cc-bbf1-b9489afe0b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:51.409755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddd84b-8119-48cc-bbf1-b9489afe0b3c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:51.427078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 541/1076] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:51.451208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff3802-029b-4a4b-8753-3fc680e61b7a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:51.526071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 536/1077] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:51.532336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddd84b-8119-48cc-bbf1-b9489afe0b3c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:51.567406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff3802-029b-4a4b-8753-3fc680e61b7a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:51.606334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8e04d-1d72-431b-96f2-9d997c5bd44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:51.607076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8e04d-1d72-431b-96f2-9d997c5bd44d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.607362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8e04d-1d72-431b-96f2-9d997c5bd44d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.607639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8e04d-1d72-431b-96f2-9d997c5bd44d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.619284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8e04d-1d72-431b-96f2-9d997c5bd44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7fd8e04d-1d72-431b-96f2-9d997c5bd44d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:51.629272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:51.630207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:51.631048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 542/1078] 10.222.0.49 () {56 vars in 1120 bytes} [Tue Jun 28 11:56:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:51.636274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8e04d-1d72-431b-96f2-9d997c5bd44d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:51.648747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:51.653442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddd84b-8119-48cc-bbf1-b9489afe0b3c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:51.653581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:51.691831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145985a-01ed-412c-8233-779b2149db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:51.692655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145985a-01ed-412c-8233-779b2149db15 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.692938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145985a-01ed-412c-8233-779b2149db15 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.693576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145985a-01ed-412c-8233-779b2149db15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.705330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145985a-01ed-412c-8233-779b2149db15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:51.706801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145985a-01ed-412c-8233-779b2149db15 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-3145985a-01ed-412c-8233-779b2149db15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:51.726244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:51.727277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:51.728216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:51.728216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:51.728216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:51.728216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:51.728451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 537/1079] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:51.734066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145985a-01ed-412c-8233-779b2149db15 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:51.748561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8e04d-1d72-431b-96f2-9d997c5bd44d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:51.785677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9cd6d-7116-49d1-a1ff-e09be63b9703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:51.786351 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9cd6d-7116-49d1-a1ff-e09be63b9703 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.786642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9cd6d-7116-49d1-a1ff-e09be63b9703 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.786919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9cd6d-7116-49d1-a1ff-e09be63b9703 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.787668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9cd6d-7116-49d1-a1ff-e09be63b9703 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:51.788007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9cd6d-7116-49d1-a1ff-e09be63b9703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:51.789481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9cd6d-7116-49d1-a1ff-e09be63b9703 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:51.798629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 543/1080] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Jun 28 11:56:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:51.804209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9cd6d-7116-49d1-a1ff-e09be63b9703 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:51.844783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145985a-01ed-412c-8233-779b2149db15 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:51.884161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21d339-4cdf-4102-9fac-259f1b3b4283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:51.884750 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d339-4cdf-4102-9fac-259f1b3b4283 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.885034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d339-4cdf-4102-9fac-259f1b3b4283 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.885309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d339-4cdf-4102-9fac-259f1b3b4283 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.886037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21d339-4cdf-4102-9fac-259f1b3b4283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:51.886556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:51.887028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21d339-4cdf-4102-9fac-259f1b3b4283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:51.888460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21d339-4cdf-4102-9fac-259f1b3b4283 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:51.912264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 538/1081] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:51.913347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9cd6d-7116-49d1-a1ff-e09be63b9703 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:51.951752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e212e-b20d-4fd4-b499-beda6653cdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:51.952911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e212e-b20d-4fd4-b499-beda6653cdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.953353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e212e-b20d-4fd4-b499-beda6653cdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.953807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e212e-b20d-4fd4-b499-beda6653cdb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.966452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e212e-b20d-4fd4-b499-beda6653cdb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:51.968219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e212e-b20d-4fd4-b499-beda6653cdb0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-868e212e-b20d-4fd4-b499-beda6653cdb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:51.988632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:51.989685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:51.990584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:51.990584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:51.990584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:51.990584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:51.992042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 544/1082] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:51.995118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c79bc-345e-42d9-86d2-ff1a4f0043f5 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:51.995349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c79bc-345e-42d9-86d2-ff1a4f0043f5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:51.995585 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c79bc-345e-42d9-86d2-ff1a4f0043f5 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:51.996240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e212e-b20d-4fd4-b499-beda6653cdb0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:51.997210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 539/1083] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:52.003479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a11b-6f8f-4b85-9d06-7a0777716842 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.003762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a11b-6f8f-4b85-9d06-7a0777716842 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.004189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0a11b-6f8f-4b85-9d06-7a0777716842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.021955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a6d0a11b-6f8f-4b85-9d06-7a0777716842 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:52.023166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a6d0a11b-6f8f-4b85-9d06-7a0777716842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:52.027300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:52.104372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 540/1084] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:56:52.113881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e212e-b20d-4fd4-b499-beda6653cdb0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.127117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a11b-6f8f-4b85-9d06-7a0777716842 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:52.141253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:52.154185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd97135-e6c9-43a7-9668-1caa6cc145e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.154864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd97135-e6c9-43a7-9668-1caa6cc145e1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.155150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd97135-e6c9-43a7-9668-1caa6cc145e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.155798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd97135-e6c9-43a7-9668-1caa6cc145e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.156215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd97135-e6c9-43a7-9668-1caa6cc145e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:52.157045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd97135-e6c9-43a7-9668-1caa6cc145e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:52.158667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd97135-e6c9-43a7-9668-1caa6cc145e1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:52.171481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 545/1085] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:52.178760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd97135-e6c9-43a7-9668-1caa6cc145e1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:52.238651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0a11b-6f8f-4b85-9d06-7a0777716842 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.273719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678af8-fddb-4eee-93cb-7bd6d3dfaea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.274515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678af8-fddb-4eee-93cb-7bd6d3dfaea3 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.274796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678af8-fddb-4eee-93cb-7bd6d3dfaea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.275072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678af8-fddb-4eee-93cb-7bd6d3dfaea3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.282910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:52.283323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd97135-e6c9-43a7-9668-1caa6cc145e1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.285768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0678af8-fddb-4eee-93cb-7bd6d3dfaea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-e0678af8-fddb-4eee-93cb-7bd6d3dfaea3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:52.293447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:52.294652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:52.295856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 541/1086] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:52.301142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678af8-fddb-4eee-93cb-7bd6d3dfaea3 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:52.321215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0e2b2-4d7d-4d77-aaba-6b45b1e046ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.322007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0e2b2-4d7d-4d77-aaba-6b45b1e046ab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.322292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0e2b2-4d7d-4d77-aaba-6b45b1e046ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.322569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0e2b2-4d7d-4d77-aaba-6b45b1e046ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.330372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0e2b2-4d7d-4d77-aaba-6b45b1e046ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:52.331807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0e2b2-4d7d-4d77-aaba-6b45b1e046ab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f7a0e2b2-4d7d-4d77-aaba-6b45b1e046ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:56:52.346165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:52.347242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:52.348223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 546/1087] 10.222.0.49 () {56 vars in 1093 bytes} [Tue Jun 28 11:56:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:52.353193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0e2b2-4d7d-4d77-aaba-6b45b1e046ab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:52.400186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:52.401826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678af8-fddb-4eee-93cb-7bd6d3dfaea3 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.437456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ba747-76c2-4932-ae76-c1649a742b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.438792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ba747-76c2-4932-ae76-c1649a742b3c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.439214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ba747-76c2-4932-ae76-c1649a742b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.439489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ba747-76c2-4932-ae76-c1649a742b3c None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.440274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ba747-76c2-4932-ae76-c1649a742b3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:52.440583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ba747-76c2-4932-ae76-c1649a742b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:52.442009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ba747-76c2-4932-ae76-c1649a742b3c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:52.450619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 542/1088] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:52.455764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0e2b2-4d7d-4d77-aaba-6b45b1e046ab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.456318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ba747-76c2-4932-ae76-c1649a742b3c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:52.491212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf11fe-6062-428a-8619-262c285aaa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.491908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf11fe-6062-428a-8619-262c285aaa60 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.492200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf11fe-6062-428a-8619-262c285aaa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.492511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf11fe-6062-428a-8619-262c285aaa60 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.493359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf11fe-6062-428a-8619-262c285aaa60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:52.493675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf11fe-6062-428a-8619-262c285aaa60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:52.495114 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf11fe-6062-428a-8619-262c285aaa60 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:52.512949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 547/1089] 10.222.0.49 () {56 vars in 1133 bytes} [Tue Jun 28 11:56:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:52.518601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf11fe-6062-428a-8619-262c285aaa60 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:52.519553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:52.557919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ba747-76c2-4932-ae76-c1649a742b3c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.591835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af5a92-725c-4db6-8b13-17cea1386a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.592730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af5a92-725c-4db6-8b13-17cea1386a08 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.593017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af5a92-725c-4db6-8b13-17cea1386a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.593294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af5a92-725c-4db6-8b13-17cea1386a08 None admin] PATH_INFO: `/v3/users/9a6ed104a77e4d97bcf90128129548b9` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.594947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af5a92-725c-4db6-8b13-17cea1386a08 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6ed104a77e4d97bcf90128129548b9)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:52.596428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af5a92-725c-4db6-8b13-17cea1386a08 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:52.598081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 543/1090] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:56:52 2022] GET /identity/v3/users/9a6ed104a77e4d97bcf90128129548b9 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:52.603902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af5a92-725c-4db6-8b13-17cea1386a08 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:52.620438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf11fe-6062-428a-8619-262c285aaa60 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.622704 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:52.655244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be0668-b797-4347-9038-4a67295f6603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.656084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be0668-b797-4347-9038-4a67295f6603 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.656857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be0668-b797-4347-9038-4a67295f6603 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.660803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be0668-b797-4347-9038-4a67295f6603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.708635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af5a92-725c-4db6-8b13-17cea1386a08 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.730266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be0668-b797-4347-9038-4a67295f6603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:52.731712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be0668-b797-4347-9038-4a67295f6603 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:52.736969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:52.742954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb1da3-7c70-4958-b3c7-15c033f6480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.743890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb1da3-7c70-4958-b3c7-15c033f6480a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.744190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb1da3-7c70-4958-b3c7-15c033f6480a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.744458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb1da3-7c70-4958-b3c7-15c033f6480a None admin] PATH_INFO: `/v3/projects/b787da378c1748e0811386067d159b10` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.745678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb1da3-7c70-4958-b3c7-15c033f6480a None admin] RBAC: Authorizing `identity:get_project(project_id=b787da378c1748e0811386067d159b10)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:52.747100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb1da3-7c70-4958-b3c7-15c033f6480a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:52.749043 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 544/1091] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:56:52 2022] GET /identity/v3/projects/b787da378c1748e0811386067d159b10 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:52.755290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb1da3-7c70-4958-b3c7-15c033f6480a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:52.832517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 548/1092] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 11:56:52.838162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be0668-b797-4347-9038-4a67295f6603 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:52.840871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:52.853689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb1da3-7c70-4958-b3c7-15c033f6480a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.887764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02384682-7e99-48ce-abea-27d309e04ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.888683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02384682-7e99-48ce-abea-27d309e04ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.888969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02384682-7e99-48ce-abea-27d309e04ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.889245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02384682-7e99-48ce-abea-27d309e04ef6 None admin] PATH_INFO: `/v3/projects/b787da378c1748e0811386067d159b10/users/9a6ed104a77e4d97bcf90128129548b9/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.891331 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02384682-7e99-48ce-abea-27d309e04ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b787da378c1748e0811386067d159b10, user_id=9a6ed104a77e4d97bcf90128129548b9, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:52.892904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02384682-7e99-48ce-abea-27d309e04ef6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:52.935019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be0668-b797-4347-9038-4a67295f6603 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:52.953147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 545/1093] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:56:52 2022] PUT /identity/v3/projects/b787da378c1748e0811386067d159b10/users/9a6ed104a77e4d97bcf90128129548b9/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 11:56:52.970645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e29c7-011d-427b-a6ff-10d99ae2c082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:52.971454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e29c7-011d-427b-a6ff-10d99ae2c082 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:52.971743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e29c7-011d-427b-a6ff-10d99ae2c082 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:52.972060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e29c7-011d-427b-a6ff-10d99ae2c082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:52.983968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e29c7-011d-427b-a6ff-10d99ae2c082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:52.985507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e29c7-011d-427b-a6ff-10d99ae2c082 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ec5e29c7-011d-427b-a6ff-10d99ae2c082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:56:53.004949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:53.006100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:53.007055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:56:53.007055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:56:53.007055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:56:53.007055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:53.007055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 549/1094] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:56:53.012271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02384682-7e99-48ce-abea-27d309e04ef6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:53.073339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:53.118946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02384682-7e99-48ce-abea-27d309e04ef6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:53.152430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957af699-d1e8-43dc-87d3-12743c6a9ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:53.153090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957af699-d1e8-43dc-87d3-12743c6a9ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:53.153373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957af699-d1e8-43dc-87d3-12743c6a9ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:53.153650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957af699-d1e8-43dc-87d3-12743c6a9ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:53.154371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957af699-d1e8-43dc-87d3-12743c6a9ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:53.154680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957af699-d1e8-43dc-87d3-12743c6a9ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:53.156080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957af699-d1e8-43dc-87d3-12743c6a9ca5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:53.166983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 546/1095] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:53.173189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e29c7-011d-427b-a6ff-10d99ae2c082 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:53.228027 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:53.270992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e29c7-011d-427b-a6ff-10d99ae2c082 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:53.304375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50e308-cb00-47f7-829f-24501f79d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:53.305160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e308-cb00-47f7-829f-24501f79d135 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:53.305446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e308-cb00-47f7-829f-24501f79d135 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:53.305724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e308-cb00-47f7-829f-24501f79d135 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:53.312218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50e308-cb00-47f7-829f-24501f79d135 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:53.314598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50e308-cb00-47f7-829f-24501f79d135 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2a50e308-cb00-47f7-829f-24501f79d135 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:56:53.328269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:53.329421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:53.330626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:56:53.330626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:56:53.330626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:56:53.330626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:56:53.330626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:56:53.330626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:56:53.330626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:56:53.330626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:56:53.330626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 550/1096] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:53.335310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957af699-d1e8-43dc-87d3-12743c6a9ca5 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:53.433467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957af699-d1e8-43dc-87d3-12743c6a9ca5 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:53.450467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:53.466606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f256585-b692-487f-b2ee-e2ead9f4de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:53.467263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f256585-b692-487f-b2ee-e2ead9f4de04 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:53.467541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f256585-b692-487f-b2ee-e2ead9f4de04 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:53.467812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f256585-b692-487f-b2ee-e2ead9f4de04 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:53.468633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f256585-b692-487f-b2ee-e2ead9f4de04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:53.468939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f256585-b692-487f-b2ee-e2ead9f4de04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:53.470747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f256585-b692-487f-b2ee-e2ead9f4de04 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:53.494968 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 547/1097] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:56:53.495131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50e308-cb00-47f7-829f-24501f79d135 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:53.594986 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50e308-cb00-47f7-829f-24501f79d135 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:53.611631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:53.628963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525e36e-d400-47b4-a831-16db4372443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:53.629620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e36e-d400-47b4-a831-16db4372443b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:53.629906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e36e-d400-47b4-a831-16db4372443b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:53.630184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525e36e-d400-47b4-a831-16db4372443b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:53.631018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525e36e-d400-47b4-a831-16db4372443b None admin] RBAC: Adding query filter params (role.id=0c79e2ac1c3248618dfc1b9f7374a15a, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=fbfe6b7a82f746169a39976be263aa29) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:53.631333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525e36e-d400-47b4-a831-16db4372443b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:53.632851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525e36e-d400-47b4-a831-16db4372443b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:53.648005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 551/1098] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:53 2022] GET /identity/v3/role_assignments?user.id=fbfe6b7a82f746169a39976be263aa29&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=0c79e2ac1c3248618dfc1b9f7374a15a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:54.989842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e78e9b-f66b-43be-a4af-4fe87df89bd2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:54.990367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e78e9b-f66b-43be-a4af-4fe87df89bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:54.990458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e78e9b-f66b-43be-a4af-4fe87df89bd2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:54.991765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 548/1099] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:54.996926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61635e-a7d6-4169-8f95-8a6e262ab026 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:54.997305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61635e-a7d6-4169-8f95-8a6e262ab026 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:54.997477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61635e-a7d6-4169-8f95-8a6e262ab026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:55.014427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8e61635e-a7d6-4169-8f95-8a6e262ab026 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:55.015610 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e61635e-a7d6-4169-8f95-8a6e262ab026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:55.080275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 552/1100] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:55.103812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e78e9b-f66b-43be-a4af-4fe87df89bd2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:55.200875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e78e9b-f66b-43be-a4af-4fe87df89bd2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:55.234946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dded7-b1d7-4d82-b089-4910a04121bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:55.235795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dded7-b1d7-4d82-b089-4910a04121bd None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:55.236108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dded7-b1d7-4d82-b089-4910a04121bd None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:55.236384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dded7-b1d7-4d82-b089-4910a04121bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:55.246266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dded7-b1d7-4d82-b089-4910a04121bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-336dded7-b1d7-4d82-b089-4910a04121bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:56:55.254455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:56:55.255536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:56:55.256551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 549/1101] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:56:55.261344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61635e-a7d6-4169-8f95-8a6e262ab026 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:55.363823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61635e-a7d6-4169-8f95-8a6e262ab026 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:55.374085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:55.396959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49684ace-f4b8-4ba2-9754-f8009c9a6f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:55.397624 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49684ace-f4b8-4ba2-9754-f8009c9a6f7e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:55.397916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49684ace-f4b8-4ba2-9754-f8009c9a6f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:55.398386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49684ace-f4b8-4ba2-9754-f8009c9a6f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:55.399328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49684ace-f4b8-4ba2-9754-f8009c9a6f7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:55.399688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49684ace-f4b8-4ba2-9754-f8009c9a6f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:55.401331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49684ace-f4b8-4ba2-9754-f8009c9a6f7e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:55.409114 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 553/1102] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:55.414756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dded7-b1d7-4d82-b089-4910a04121bd None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:55.455024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:55.515541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dded7-b1d7-4d82-b089-4910a04121bd None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:55.548909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427a03d-672d-4e3e-89e7-72f69640b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:55.549780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427a03d-672d-4e3e-89e7-72f69640b903 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:55.550063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427a03d-672d-4e3e-89e7-72f69640b903 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:55.550336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427a03d-672d-4e3e-89e7-72f69640b903 None admin] PATH_INFO: `/v3/users/9a6ed104a77e4d97bcf90128129548b9` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:55.551721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427a03d-672d-4e3e-89e7-72f69640b903 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6ed104a77e4d97bcf90128129548b9)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:55.553454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427a03d-672d-4e3e-89e7-72f69640b903 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:55.555151 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 550/1103] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:56:55 2022] GET /identity/v3/users/9a6ed104a77e4d97bcf90128129548b9 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:55.560809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49684ace-f4b8-4ba2-9754-f8009c9a6f7e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:55.657713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49684ace-f4b8-4ba2-9754-f8009c9a6f7e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:55.690435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47602b00-00b4-4abb-9ad9-5d214da13fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:55.691067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602b00-00b4-4abb-9ad9-5d214da13fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:55.691357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602b00-00b4-4abb-9ad9-5d214da13fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:55.691635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602b00-00b4-4abb-9ad9-5d214da13fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:55.730381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:55.756481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47602b00-00b4-4abb-9ad9-5d214da13fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:55.758011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47602b00-00b4-4abb-9ad9-5d214da13fa1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:55.853925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 554/1104] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:56:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:56:55.860528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427a03d-672d-4e3e-89e7-72f69640b903 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:55.956155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427a03d-672d-4e3e-89e7-72f69640b903 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:55.962678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:55.988921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049f174-eb96-4863-905d-5790b3f3de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:55.989779 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f174-eb96-4863-905d-5790b3f3de58 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:55.990061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f174-eb96-4863-905d-5790b3f3de58 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:55.990581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f174-eb96-4863-905d-5790b3f3de58 None admin] PATH_INFO: `/v3/projects/b787da378c1748e0811386067d159b10` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:55.991501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049f174-eb96-4863-905d-5790b3f3de58 None admin] RBAC: Authorizing `identity:get_project(project_id=b787da378c1748e0811386067d159b10)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:55.992958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049f174-eb96-4863-905d-5790b3f3de58 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:55.994630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 551/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:56:55 2022] GET /identity/v3/projects/b787da378c1748e0811386067d159b10 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:56.000667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47602b00-00b4-4abb-9ad9-5d214da13fa1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:56.067641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:56.095643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47602b00-00b4-4abb-9ad9-5d214da13fa1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:56.130214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a15c6-e037-4758-95bf-959cfd9f0671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:56.130800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a15c6-e037-4758-95bf-959cfd9f0671 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:56.131084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a15c6-e037-4758-95bf-959cfd9f0671 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:56.131360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a15c6-e037-4758-95bf-959cfd9f0671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:56.132219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a15c6-e037-4758-95bf-959cfd9f0671 None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=b787da378c1748e0811386067d159b10, user.id=9a6ed104a77e4d97bcf90128129548b9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:56:56.132533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a15c6-e037-4758-95bf-959cfd9f0671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:56.133950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a15c6-e037-4758-95bf-959cfd9f0671 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:56.139585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 555/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:56:55 2022] GET /identity/v3/role_assignments?user.id=9a6ed104a77e4d97bcf90128129548b9&scope.project.id=b787da378c1748e0811386067d159b10&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:58.184605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f2124-9501-45a0-ab4a-778f5fd9335f None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:58.185199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f2124-9501-45a0-ab4a-778f5fd9335f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:58.185199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f2124-9501-45a0-ab4a-778f5fd9335f None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:58.186537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 552/1107] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:56:58.192579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042615-d1b5-4d24-a684-0694a2fb9a8d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:58.193005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042615-d1b5-4d24-a684-0694a2fb9a8d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:58.193110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94042615-d1b5-4d24-a684-0694a2fb9a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:58.210011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-94042615-d1b5-4d24-a684-0694a2fb9a8d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:56:58.211184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-94042615-d1b5-4d24-a684-0694a2fb9a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:56:58.274685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 556/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:56:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:56:58.299166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f2124-9501-45a0-ab4a-778f5fd9335f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:58.397326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f2124-9501-45a0-ab4a-778f5fd9335f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:58.428820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46f57b-b677-4521-8ae5-7d1f525b4788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:58.429593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46f57b-b677-4521-8ae5-7d1f525b4788 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:58.429874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46f57b-b677-4521-8ae5-7d1f525b4788 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:58.430153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46f57b-b677-4521-8ae5-7d1f525b4788 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:58.431297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46f57b-b677-4521-8ae5-7d1f525b4788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:58.432749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46f57b-b677-4521-8ae5-7d1f525b4788 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:58.434316 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 553/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:56:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:56:58.440547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042615-d1b5-4d24-a684-0694a2fb9a8d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:56:58.502635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:56:58.534827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94042615-d1b5-4d24-a684-0694a2fb9a8d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:56:58.568639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612abb98-85d9-478c-8363-238134ff16cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:56:58.569298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612abb98-85d9-478c-8363-238134ff16cf None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:56:58.569576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612abb98-85d9-478c-8363-238134ff16cf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:56:58.569848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612abb98-85d9-478c-8363-238134ff16cf None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:56:58.570549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612abb98-85d9-478c-8363-238134ff16cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:56:58.572000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612abb98-85d9-478c-8363-238134ff16cf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:56:58.655665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 557/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:56:58 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:57:00.706214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc005f9-7fd3-4965-b0d7-cdef58d6c774 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:00.706751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc005f9-7fd3-4965-b0d7-cdef58d6c774 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:00.706751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc005f9-7fd3-4965-b0d7-cdef58d6c774 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:00.708187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 554/1111] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:00.713197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c054-9664-4ef7-bbcd-cd1f7588b47d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:00.713579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c054-9664-4ef7-bbcd-cd1f7588b47d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:00.713758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9c054-9664-4ef7-bbcd-cd1f7588b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:00.730437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-79c9c054-9664-4ef7-bbcd-cd1f7588b47d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:00.731681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-79c9c054-9664-4ef7-bbcd-cd1f7588b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:00.797212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 558/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:00.821549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc005f9-7fd3-4965-b0d7-cdef58d6c774 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:00.865220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:00.921542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc005f9-7fd3-4965-b0d7-cdef58d6c774 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:00.954608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461045d5-06af-4d23-a773-d39c18df7532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:00.955456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461045d5-06af-4d23-a773-d39c18df7532 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:00.955742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461045d5-06af-4d23-a773-d39c18df7532 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:00.956052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461045d5-06af-4d23-a773-d39c18df7532 None admin] PATH_INFO: `/v3/roles/478978f29ae748188de8d1a31490bb00` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:00.957530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461045d5-06af-4d23-a773-d39c18df7532 None admin] RBAC: Authorizing `identity:get_role(role_id=478978f29ae748188de8d1a31490bb00)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:00.958910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461045d5-06af-4d23-a773-d39c18df7532 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:00.960315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 555/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:00 2022] GET /identity/v3/roles/478978f29ae748188de8d1a31490bb00 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:00.966073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9c054-9664-4ef7-bbcd-cd1f7588b47d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:01.016881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:01.061227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9c054-9664-4ef7-bbcd-cd1f7588b47d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:01.093299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367750d-c7be-442b-9bee-f2043006efd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:01.094712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367750d-c7be-442b-9bee-f2043006efd5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:01.094983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367750d-c7be-442b-9bee-f2043006efd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:01.095254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367750d-c7be-442b-9bee-f2043006efd5 None admin] PATH_INFO: `/v3/users/32e68d57d1914613b1e94256124c74df` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:01.108115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367750d-c7be-442b-9bee-f2043006efd5 None admin] RBAC: Authorizing `identity:get_user(user_id=32e68d57d1914613b1e94256124c74df)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:01.110093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367750d-c7be-442b-9bee-f2043006efd5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:01.111774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 559/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:00 2022] GET /identity/v3/users/32e68d57d1914613b1e94256124c74df => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:01.117450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461045d5-06af-4d23-a773-d39c18df7532 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:01.211757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461045d5-06af-4d23-a773-d39c18df7532 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:01.222108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:01.244609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b774b5-46d8-45d2-9cdc-072103e02dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:01.245240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b774b5-46d8-45d2-9cdc-072103e02dbb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:01.245519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b774b5-46d8-45d2-9cdc-072103e02dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:01.245790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b774b5-46d8-45d2-9cdc-072103e02dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:01.310352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b774b5-46d8-45d2-9cdc-072103e02dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:01.311847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b774b5-46d8-45d2-9cdc-072103e02dbb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:01.407852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 556/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:57:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:01.413684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367750d-c7be-442b-9bee-f2043006efd5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:01.508973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367750d-c7be-442b-9bee-f2043006efd5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:01.520014 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:01.543131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d9689-0b4b-433b-a5c0-d22d13469261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:01.544029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d9689-0b4b-433b-a5c0-d22d13469261 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:01.544315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d9689-0b4b-433b-a5c0-d22d13469261 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:01.544592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d9689-0b4b-433b-a5c0-d22d13469261 None admin] PATH_INFO: `/v3/projects/b787da378c1748e0811386067d159b10` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:01.545772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d9689-0b4b-433b-a5c0-d22d13469261 None admin] RBAC: Authorizing `identity:get_project(project_id=b787da378c1748e0811386067d159b10)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:01.547204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d9689-0b4b-433b-a5c0-d22d13469261 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:01.551281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 560/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:57:01 2022] GET /identity/v3/projects/b787da378c1748e0811386067d159b10 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:01.557379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b774b5-46d8-45d2-9cdc-072103e02dbb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:01.568811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:01.653611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b774b5-46d8-45d2-9cdc-072103e02dbb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:01.685970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d010-9647-4796-9b01-d0f907f7cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:01.686607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d010-9647-4796-9b01-d0f907f7cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:01.686886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d010-9647-4796-9b01-d0f907f7cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:01.687160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d010-9647-4796-9b01-d0f907f7cbc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:01.688191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d010-9647-4796-9b01-d0f907f7cbc2 None admin] RBAC: Adding query filter params (role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=b787da378c1748e0811386067d159b10, user.id=32e68d57d1914613b1e94256124c74df) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:01.688499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d010-9647-4796-9b01-d0f907f7cbc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:01.689923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d010-9647-4796-9b01-d0f907f7cbc2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:01.695185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 557/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:57:01 2022] GET /identity/v3/role_assignments?user.id=32e68d57d1914613b1e94256124c74df&scope.project.id=b787da378c1748e0811386067d159b10&role.id=478978f29ae748188de8d1a31490bb00 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:57:03.705677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b0d6-b0e7-42f4-a0d3-f37e07c65c94 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:03.706197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b0d6-b0e7-42f4-a0d3-f37e07c65c94 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:03.706314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b0d6-b0e7-42f4-a0d3-f37e07c65c94 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:03.707591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 561/1118] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:03.712856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789f99d-d27c-4f35-9870-4f4cccbb558b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:03.713293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789f99d-d27c-4f35-9870-4f4cccbb558b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:03.713420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789f99d-d27c-4f35-9870-4f4cccbb558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:03.730048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f789f99d-d27c-4f35-9870-4f4cccbb558b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:03.731237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f789f99d-d27c-4f35-9870-4f4cccbb558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:03.795435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 558/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:03.819412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b0d6-b0e7-42f4-a0d3-f37e07c65c94 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:03.918733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b0d6-b0e7-42f4-a0d3-f37e07c65c94 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:03.952420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd11a5-ff67-4a62-ba79-6423f9d769f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:03.953794 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd11a5-ff67-4a62-ba79-6423f9d769f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:03.954138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd11a5-ff67-4a62-ba79-6423f9d769f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:03.954412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd11a5-ff67-4a62-ba79-6423f9d769f6 None admin] PATH_INFO: `/v3/roles/478978f29ae748188de8d1a31490bb00` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:03.955889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd11a5-ff67-4a62-ba79-6423f9d769f6 None admin] RBAC: Authorizing `identity:get_role(role_id=478978f29ae748188de8d1a31490bb00)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:03.957253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd11a5-ff67-4a62-ba79-6423f9d769f6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:03.958616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 562/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:03 2022] GET /identity/v3/roles/478978f29ae748188de8d1a31490bb00 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:03.964748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789f99d-d27c-4f35-9870-4f4cccbb558b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:03.967793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:04.059650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789f99d-d27c-4f35-9870-4f4cccbb558b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:04.092159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180ed96-02de-48a9-9a7d-39b9638f94a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:04.093012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180ed96-02de-48a9-9a7d-39b9638f94a1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:04.093293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180ed96-02de-48a9-9a7d-39b9638f94a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:04.093684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180ed96-02de-48a9-9a7d-39b9638f94a1 None admin] PATH_INFO: `/v3/users/32e68d57d1914613b1e94256124c74df` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:04.095362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180ed96-02de-48a9-9a7d-39b9638f94a1 None admin] RBAC: Authorizing `identity:get_user(user_id=32e68d57d1914613b1e94256124c74df)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:04.096806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180ed96-02de-48a9-9a7d-39b9638f94a1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:04.098401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 559/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:03 2022] GET /identity/v3/users/32e68d57d1914613b1e94256124c74df => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:04.104642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd11a5-ff67-4a62-ba79-6423f9d769f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:04.150392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:04.201245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd11a5-ff67-4a62-ba79-6423f9d769f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:04.234185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226db9b-79b1-45cb-bb0f-25c7b864aee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:04.235031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226db9b-79b1-45cb-bb0f-25c7b864aee6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:04.235314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226db9b-79b1-45cb-bb0f-25c7b864aee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:04.235587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226db9b-79b1-45cb-bb0f-25c7b864aee6 None admin] PATH_INFO: `/v3/projects/b787da378c1748e0811386067d159b10` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:04.236788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226db9b-79b1-45cb-bb0f-25c7b864aee6 None admin] RBAC: Authorizing `identity:get_project(project_id=b787da378c1748e0811386067d159b10)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:04.238194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226db9b-79b1-45cb-bb0f-25c7b864aee6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:04.239858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 563/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:57:04 2022] GET /identity/v3/projects/b787da378c1748e0811386067d159b10 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:04.245660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180ed96-02de-48a9-9a7d-39b9638f94a1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:04.312974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:04.341318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180ed96-02de-48a9-9a7d-39b9638f94a1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:04.374462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce2119-707d-4f26-a340-0a4b0fb67f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:04.375552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce2119-707d-4f26-a340-0a4b0fb67f04 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:04.375837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce2119-707d-4f26-a340-0a4b0fb67f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:04.376152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce2119-707d-4f26-a340-0a4b0fb67f04 None admin] PATH_INFO: `/v3/projects/b787da378c1748e0811386067d159b10/users/32e68d57d1914613b1e94256124c74df/roles/478978f29ae748188de8d1a31490bb00` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:04.378919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce2119-707d-4f26-a340-0a4b0fb67f04 None admin] RBAC: Authorizing `identity:create_grant(project_id=b787da378c1748e0811386067d159b10, user_id=32e68d57d1914613b1e94256124c74df, role_id=478978f29ae748188de8d1a31490bb00)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:04.380394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce2119-707d-4f26-a340-0a4b0fb67f04 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:04.452917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 560/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:57:04 2022] PUT /identity/v3/projects/b787da378c1748e0811386067d159b10/users/32e68d57d1914613b1e94256124c74df/roles/478978f29ae748188de8d1a31490bb00 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:57:06.440261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c03bb1-0c04-4e67-aa20-43f4138ff029 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:06.440813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c03bb1-0c04-4e67-aa20-43f4138ff029 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:06.440813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c03bb1-0c04-4e67-aa20-43f4138ff029 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:06.442173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 564/1124] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:06.447223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12053b-bb3b-4b4d-9d59-c999e0fe8daa None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:06.447608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12053b-bb3b-4b4d-9d59-c999e0fe8daa None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:06.447777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12053b-bb3b-4b4d-9d59-c999e0fe8daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:06.464547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ab12053b-bb3b-4b4d-9d59-c999e0fe8daa None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:06.465717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ab12053b-bb3b-4b4d-9d59-c999e0fe8daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:06.530059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 561/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:06.553604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c03bb1-0c04-4e67-aa20-43f4138ff029 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:06.653736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c03bb1-0c04-4e67-aa20-43f4138ff029 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:06.667192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:06.687627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e52bde-9fef-44c5-bbfd-10e2dc9cee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:06.688665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e52bde-9fef-44c5-bbfd-10e2dc9cee48 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:06.688953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e52bde-9fef-44c5-bbfd-10e2dc9cee48 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:06.689232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e52bde-9fef-44c5-bbfd-10e2dc9cee48 None admin] PATH_INFO: `/v3/roles/478978f29ae748188de8d1a31490bb00` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:06.690762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e52bde-9fef-44c5-bbfd-10e2dc9cee48 None admin] RBAC: Authorizing `identity:get_role(role_id=478978f29ae748188de8d1a31490bb00)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:06.692151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e52bde-9fef-44c5-bbfd-10e2dc9cee48 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:06.693526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 565/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:06 2022] GET /identity/v3/roles/478978f29ae748188de8d1a31490bb00 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:06.699350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12053b-bb3b-4b4d-9d59-c999e0fe8daa None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:06.759504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:06.796967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12053b-bb3b-4b4d-9d59-c999e0fe8daa None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:06.830938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783c5a9-f66e-406d-94c7-6a99f5f0966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:06.831802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783c5a9-f66e-406d-94c7-6a99f5f0966a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:06.832114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783c5a9-f66e-406d-94c7-6a99f5f0966a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:06.832389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783c5a9-f66e-406d-94c7-6a99f5f0966a None admin] PATH_INFO: `/v3/users/32e68d57d1914613b1e94256124c74df` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:06.833573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783c5a9-f66e-406d-94c7-6a99f5f0966a None admin] RBAC: Authorizing `identity:get_user(user_id=32e68d57d1914613b1e94256124c74df)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:06.835008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783c5a9-f66e-406d-94c7-6a99f5f0966a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:06.836670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 562/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:06 2022] GET /identity/v3/users/32e68d57d1914613b1e94256124c74df => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:06.842206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e52bde-9fef-44c5-bbfd-10e2dc9cee48 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:06.939852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e52bde-9fef-44c5-bbfd-10e2dc9cee48 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:06.973751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadfd3b-cf98-441a-a835-3606381d29aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:06.974580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadfd3b-cf98-441a-a835-3606381d29aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:06.974860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadfd3b-cf98-441a-a835-3606381d29aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:06.975134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadfd3b-cf98-441a-a835-3606381d29aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:07.022549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:07.040724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadfd3b-cf98-441a-a835-3606381d29aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:07.042210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadfd3b-cf98-441a-a835-3606381d29aa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:07.136049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 566/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:57:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:07.141970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783c5a9-f66e-406d-94c7-6a99f5f0966a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:07.239457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783c5a9-f66e-406d-94c7-6a99f5f0966a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:07.266545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:07.272176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383715f-a225-43e9-a0e3-c196f4db846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:07.273026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383715f-a225-43e9-a0e3-c196f4db846c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:07.273308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383715f-a225-43e9-a0e3-c196f4db846c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:07.273580 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383715f-a225-43e9-a0e3-c196f4db846c None admin] PATH_INFO: `/v3/projects/b787da378c1748e0811386067d159b10` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:07.274748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383715f-a225-43e9-a0e3-c196f4db846c None admin] RBAC: Authorizing `identity:get_project(project_id=b787da378c1748e0811386067d159b10)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:07.276226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383715f-a225-43e9-a0e3-c196f4db846c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:07.280518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 563/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:57:07 2022] GET /identity/v3/projects/b787da378c1748e0811386067d159b10 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:07.284500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadfd3b-cf98-441a-a835-3606381d29aa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:07.362778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:07.379509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadfd3b-cf98-441a-a835-3606381d29aa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:07.413424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f80e1-2181-4011-8876-c2dbc99e2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:07.414054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f80e1-2181-4011-8876-c2dbc99e2701 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:07.414334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f80e1-2181-4011-8876-c2dbc99e2701 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:07.414608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f80e1-2181-4011-8876-c2dbc99e2701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:07.415425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f80e1-2181-4011-8876-c2dbc99e2701 None admin] RBAC: Adding query filter params (role.id=478978f29ae748188de8d1a31490bb00, scope.project.id=b787da378c1748e0811386067d159b10, user.id=32e68d57d1914613b1e94256124c74df) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:07.415733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f80e1-2181-4011-8876-c2dbc99e2701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:07.417183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f80e1-2181-4011-8876-c2dbc99e2701 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:07.422818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 567/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:57:07 2022] GET /identity/v3/role_assignments?user.id=32e68d57d1914613b1e94256124c74df&scope.project.id=b787da378c1748e0811386067d159b10&role.id=478978f29ae748188de8d1a31490bb00 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:09.448429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69495-2fb8-4a13-aa70-840c8e49d283 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:09.457745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69495-2fb8-4a13-aa70-840c8e49d283 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:09.457745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69495-2fb8-4a13-aa70-840c8e49d283 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:09.457745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 564/1131] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:09.458041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19425-d045-4ecf-872a-ab3f7f1a3a23 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:09.458041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19425-d045-4ecf-872a-ab3f7f1a3a23 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:09.458041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a19425-d045-4ecf-872a-ab3f7f1a3a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:09.472900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-68a19425-d045-4ecf-872a-ab3f7f1a3a23 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:09.474344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-68a19425-d045-4ecf-872a-ab3f7f1a3a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:09.542128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 568/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 11:57:09.566032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69495-2fb8-4a13-aa70-840c8e49d283 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:09.665324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69495-2fb8-4a13-aa70-840c8e49d283 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:09.697376 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8fff0-7c9a-4733-9463-75e5062a1067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:09.698153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8fff0-7c9a-4733-9463-75e5062a1067 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:09.698485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8fff0-7c9a-4733-9463-75e5062a1067 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:09.698710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8fff0-7c9a-4733-9463-75e5062a1067 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:09.699904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8fff0-7c9a-4733-9463-75e5062a1067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:09.701346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8fff0-7c9a-4733-9463-75e5062a1067 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:09.702945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 565/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:09.709182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19425-d045-4ecf-872a-ab3f7f1a3a23 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:09.783365 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:09.804760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a19425-d045-4ecf-872a-ab3f7f1a3a23 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:09.837450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8afb79-9a96-47eb-bb4d-a7a85dd9913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:09.838097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8afb79-9a96-47eb-bb4d-a7a85dd9913e None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:09.838376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8afb79-9a96-47eb-bb4d-a7a85dd9913e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:09.838646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8afb79-9a96-47eb-bb4d-a7a85dd9913e None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:09.839345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8afb79-9a96-47eb-bb4d-a7a85dd9913e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:09.840779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8afb79-9a96-47eb-bb4d-a7a85dd9913e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:09.968748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 569/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:57:09 2022] POST /identity/v3/projects => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:57:12.013482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb34e5-b24c-41b9-bfc3-9986a1ca7a51 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:12.014041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb34e5-b24c-41b9-bfc3-9986a1ca7a51 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:12.014041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb34e5-b24c-41b9-bfc3-9986a1ca7a51 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:12.015386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 566/1135] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:12.021111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f84cdc-93e6-4b9f-b87d-40ab9707f1c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:12.021494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f84cdc-93e6-4b9f-b87d-40ab9707f1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:12.021660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f84cdc-93e6-4b9f-b87d-40ab9707f1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:12.038763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b5f84cdc-93e6-4b9f-b87d-40ab9707f1c0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:12.039965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b5f84cdc-93e6-4b9f-b87d-40ab9707f1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:12.105563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 570/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:12.130614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb34e5-b24c-41b9-bfc3-9986a1ca7a51 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:12.195088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:12.232897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb34e5-b24c-41b9-bfc3-9986a1ca7a51 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:12.265796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33257dd-1e8f-48c8-a0b1-77b515192783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:12.266520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33257dd-1e8f-48c8-a0b1-77b515192783 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:12.266801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33257dd-1e8f-48c8-a0b1-77b515192783 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:12.267078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33257dd-1e8f-48c8-a0b1-77b515192783 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:12.268273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33257dd-1e8f-48c8-a0b1-77b515192783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:12.269712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33257dd-1e8f-48c8-a0b1-77b515192783 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:12.271353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 567/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:12.277049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f84cdc-93e6-4b9f-b87d-40ab9707f1c0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:12.332057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:12.372212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f84cdc-93e6-4b9f-b87d-40ab9707f1c0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:12.404524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad355fe-cfe0-4bf3-9d78-5b017f875669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:12.405180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad355fe-cfe0-4bf3-9d78-5b017f875669 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:12.405460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad355fe-cfe0-4bf3-9d78-5b017f875669 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:12.405731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad355fe-cfe0-4bf3-9d78-5b017f875669 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:12.407118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad355fe-cfe0-4bf3-9d78-5b017f875669 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:12.408556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad355fe-cfe0-4bf3-9d78-5b017f875669 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:12.500482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 571/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:57:12 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:57:14.565013 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e00a5f-8229-44b1-8998-e6c6f9eb899c None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:14.565517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e00a5f-8229-44b1-8998-e6c6f9eb899c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:14.565612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e00a5f-8229-44b1-8998-e6c6f9eb899c None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:14.566932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 568/1139] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 11:57:14.572169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5a4e-8818-4ad1-bf8e-1ed3d5b5845a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:14.572547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5a4e-8818-4ad1-bf8e-1ed3d5b5845a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:14.572729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a5a4e-8818-4ad1-bf8e-1ed3d5b5845a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:14.589622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-202a5a4e-8818-4ad1-bf8e-1ed3d5b5845a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:14.590793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-202a5a4e-8818-4ad1-bf8e-1ed3d5b5845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:14.654625 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 572/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:14.677784 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e00a5f-8229-44b1-8998-e6c6f9eb899c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:14.780771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e00a5f-8229-44b1-8998-e6c6f9eb899c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:14.813576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460043-1626-473f-89a4-e5a68cbd3714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:14.814359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460043-1626-473f-89a4-e5a68cbd3714 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:14.814862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460043-1626-473f-89a4-e5a68cbd3714 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:14.814973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac460043-1626-473f-89a4-e5a68cbd3714 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:14.816788 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:14.825684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac460043-1626-473f-89a4-e5a68cbd3714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-ac460043-1626-473f-89a4-e5a68cbd3714 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:57:14.833935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:57:14.835126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:57:14.836074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 569/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:57:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:57:14.841360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5a4e-8818-4ad1-bf8e-1ed3d5b5845a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:14.887794 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:14.942330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a5a4e-8818-4ad1-bf8e-1ed3d5b5845a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:14.991359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a28cd-6a39-4cb9-b497-fe56aa778458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:14.992061 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a28cd-6a39-4cb9-b497-fe56aa778458 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:14.992349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a28cd-6a39-4cb9-b497-fe56aa778458 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:14.992623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a28cd-6a39-4cb9-b497-fe56aa778458 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:14.993380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a28cd-6a39-4cb9-b497-fe56aa778458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:14.993691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a28cd-6a39-4cb9-b497-fe56aa778458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:14.995383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a28cd-6a39-4cb9-b497-fe56aa778458 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:15.004597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 573/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:57:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:15.010467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460043-1626-473f-89a4-e5a68cbd3714 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:15.132886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac460043-1626-473f-89a4-e5a68cbd3714 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:15.175567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5566c-2c28-4779-9f55-24ba0bb057d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:15.176469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5566c-2c28-4779-9f55-24ba0bb057d1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:15.176750 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5566c-2c28-4779-9f55-24ba0bb057d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:15.177020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5566c-2c28-4779-9f55-24ba0bb057d1 None admin] PATH_INFO: `/v3/users/86172e62ed6841e4b6a17a90f9a2a6f6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:15.191328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5566c-2c28-4779-9f55-24ba0bb057d1 None admin] RBAC: Authorizing `identity:get_user(user_id=86172e62ed6841e4b6a17a90f9a2a6f6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:15.192791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5566c-2c28-4779-9f55-24ba0bb057d1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:15.194437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 570/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:15 2022] GET /identity/v3/users/86172e62ed6841e4b6a17a90f9a2a6f6 => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:15.200218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a28cd-6a39-4cb9-b497-fe56aa778458 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:15.312161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a28cd-6a39-4cb9-b497-fe56aa778458 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:15.319654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:15.347134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14880b-509c-4f81-8f9b-d27adbbd9975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:15.347786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14880b-509c-4f81-8f9b-d27adbbd9975 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:15.348099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14880b-509c-4f81-8f9b-d27adbbd9975 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:15.348381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14880b-509c-4f81-8f9b-d27adbbd9975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:15.419066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14880b-509c-4f81-8f9b-d27adbbd9975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:15.420480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14880b-509c-4f81-8f9b-d27adbbd9975 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:15.528647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 574/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:57:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:15.534643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5566c-2c28-4779-9f55-24ba0bb057d1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:15.592665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:15.638911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5566c-2c28-4779-9f55-24ba0bb057d1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:15.672528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153ec1a-6c1c-4e63-90fa-ba4a74472bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:15.673632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153ec1a-6c1c-4e63-90fa-ba4a74472bdc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:15.673916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153ec1a-6c1c-4e63-90fa-ba4a74472bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:15.674193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153ec1a-6c1c-4e63-90fa-ba4a74472bdc None admin] PATH_INFO: `/v3/projects/af59bf3199794a0da73fe883a2942df8` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:15.675368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153ec1a-6c1c-4e63-90fa-ba4a74472bdc None admin] RBAC: Authorizing `identity:get_project(project_id=af59bf3199794a0da73fe883a2942df8)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:15.676845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153ec1a-6c1c-4e63-90fa-ba4a74472bdc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:15.678552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 571/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:57:15 2022] GET /identity/v3/projects/af59bf3199794a0da73fe883a2942df8 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:15.684709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14880b-509c-4f81-8f9b-d27adbbd9975 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:15.693561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:15.783193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14880b-509c-4f81-8f9b-d27adbbd9975 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:15.815797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efc3a5-bdaf-45a9-8b91-89530338394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:15.816465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efc3a5-bdaf-45a9-8b91-89530338394b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:15.816745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efc3a5-bdaf-45a9-8b91-89530338394b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:15.817013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efc3a5-bdaf-45a9-8b91-89530338394b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:15.817834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efc3a5-bdaf-45a9-8b91-89530338394b None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=af59bf3199794a0da73fe883a2942df8, user.id=86172e62ed6841e4b6a17a90f9a2a6f6) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:15.818143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efc3a5-bdaf-45a9-8b91-89530338394b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:15.819578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efc3a5-bdaf-45a9-8b91-89530338394b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:15.824864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 575/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:57:15 2022] GET /identity/v3/role_assignments?user.id=86172e62ed6841e4b6a17a90f9a2a6f6&scope.project.id=af59bf3199794a0da73fe883a2942df8&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:57:17.906977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51cc78-d641-4c78-8024-cd1b6bd47d6d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:17.907567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51cc78-d641-4c78-8024-cd1b6bd47d6d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:17.907567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51cc78-d641-4c78-8024-cd1b6bd47d6d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:17.908919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 572/1147] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:17.914165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c3339-e41c-4ff5-93a9-b8320afdf203 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:17.914571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c3339-e41c-4ff5-93a9-b8320afdf203 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:17.914727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c3339-e41c-4ff5-93a9-b8320afdf203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:17.931718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-df5c3339-e41c-4ff5-93a9-b8320afdf203 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:17.932931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df5c3339-e41c-4ff5-93a9-b8320afdf203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:17.993245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:17.997731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 576/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:18.020896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51cc78-d641-4c78-8024-cd1b6bd47d6d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:18.118799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51cc78-d641-4c78-8024-cd1b6bd47d6d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:18.138278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:18.151685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efa73f-aca7-420c-b0c4-7f27b1142f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:18.152499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efa73f-aca7-420c-b0c4-7f27b1142f7a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:18.152785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efa73f-aca7-420c-b0c4-7f27b1142f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:18.153062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efa73f-aca7-420c-b0c4-7f27b1142f7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:18.165275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efa73f-aca7-420c-b0c4-7f27b1142f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-33efa73f-aca7-420c-b0c4-7f27b1142f7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:57:18.173324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:57:18.174423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:57:18.175612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 573/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:57:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:57:18.180744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c3339-e41c-4ff5-93a9-b8320afdf203 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:18.275549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c3339-e41c-4ff5-93a9-b8320afdf203 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:18.309248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c786c-2d65-4361-91d8-b64902969aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:18.309897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c786c-2d65-4361-91d8-b64902969aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:18.310176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c786c-2d65-4361-91d8-b64902969aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:18.310449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c786c-2d65-4361-91d8-b64902969aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:18.311186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c786c-2d65-4361-91d8-b64902969aa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:18.311491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c786c-2d65-4361-91d8-b64902969aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:18.313091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c786c-2d65-4361-91d8-b64902969aa8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:18.320981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 577/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:57:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:18.326789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efa73f-aca7-420c-b0c4-7f27b1142f7a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:18.424119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efa73f-aca7-420c-b0c4-7f27b1142f7a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:18.456260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98239a57-de30-44a4-b9b7-6dc00cac0b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:18.457120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98239a57-de30-44a4-b9b7-6dc00cac0b10 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:18.457408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98239a57-de30-44a4-b9b7-6dc00cac0b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:18.457687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98239a57-de30-44a4-b9b7-6dc00cac0b10 None admin] PATH_INFO: `/v3/users/86172e62ed6841e4b6a17a90f9a2a6f6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:18.458867 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98239a57-de30-44a4-b9b7-6dc00cac0b10 None admin] RBAC: Authorizing `identity:get_user(user_id=86172e62ed6841e4b6a17a90f9a2a6f6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:18.460333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98239a57-de30-44a4-b9b7-6dc00cac0b10 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:18.461941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 574/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:18 2022] GET /identity/v3/users/86172e62ed6841e4b6a17a90f9a2a6f6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:18.467492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c786c-2d65-4361-91d8-b64902969aa8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:18.530385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:18.568152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c786c-2d65-4361-91d8-b64902969aa8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:18.600669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34591d8-b1ea-48fa-9fc0-e54c395b030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:18.601518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34591d8-b1ea-48fa-9fc0-e54c395b030a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:18.601799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34591d8-b1ea-48fa-9fc0-e54c395b030a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:18.602071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34591d8-b1ea-48fa-9fc0-e54c395b030a None admin] PATH_INFO: `/v3/projects/af59bf3199794a0da73fe883a2942df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:18.603236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34591d8-b1ea-48fa-9fc0-e54c395b030a None admin] RBAC: Authorizing `identity:get_project(project_id=af59bf3199794a0da73fe883a2942df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:18.604688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34591d8-b1ea-48fa-9fc0-e54c395b030a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:18.606371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 578/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:57:18 2022] GET /identity/v3/projects/af59bf3199794a0da73fe883a2942df8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:18.612732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98239a57-de30-44a4-b9b7-6dc00cac0b10 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:18.660821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:18.709806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98239a57-de30-44a4-b9b7-6dc00cac0b10 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:18.742023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bb337-2db9-4712-977d-0a7f8095d9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:18.742895 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bb337-2db9-4712-977d-0a7f8095d9a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:18.743177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bb337-2db9-4712-977d-0a7f8095d9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:18.743449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bb337-2db9-4712-977d-0a7f8095d9a5 None admin] PATH_INFO: `/v3/projects/af59bf3199794a0da73fe883a2942df8/users/86172e62ed6841e4b6a17a90f9a2a6f6/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:18.745393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bb337-2db9-4712-977d-0a7f8095d9a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=af59bf3199794a0da73fe883a2942df8, user_id=86172e62ed6841e4b6a17a90f9a2a6f6, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:18.746815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bb337-2db9-4712-977d-0a7f8095d9a5 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:18.842685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 575/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:57:18 2022] PUT /identity/v3/projects/af59bf3199794a0da73fe883a2942df8/users/86172e62ed6841e4b6a17a90f9a2a6f6/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:57:20.840933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d608ec-a2e1-4c2d-9918-238dffdc27a2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:20.841462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d608ec-a2e1-4c2d-9918-238dffdc27a2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:20.841462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d608ec-a2e1-4c2d-9918-238dffdc27a2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:20.842844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 579/1154] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:20.848963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f53eac-4e7f-4b00-9178-d31a66827c86 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:20.849373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f53eac-4e7f-4b00-9178-d31a66827c86 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:20.849512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f53eac-4e7f-4b00-9178-d31a66827c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:20.866336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b8f53eac-4e7f-4b00-9178-d31a66827c86 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:20.867496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b8f53eac-4e7f-4b00-9178-d31a66827c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:20.930712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 576/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:20.954047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d608ec-a2e1-4c2d-9918-238dffdc27a2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:21.052737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d608ec-a2e1-4c2d-9918-238dffdc27a2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:21.080141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:21.085637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae4138-a35a-468d-a372-f82d723fecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:21.086513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae4138-a35a-468d-a372-f82d723fecdd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:21.086793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae4138-a35a-468d-a372-f82d723fecdd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:21.087066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae4138-a35a-468d-a372-f82d723fecdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:21.097498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae4138-a35a-468d-a372-f82d723fecdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e8ae4138-a35a-468d-a372-f82d723fecdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:57:21.105204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:57:21.106314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:57:21.107367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 580/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:57:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:57:21.112445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f53eac-4e7f-4b00-9178-d31a66827c86 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:21.150311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:21.208961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f53eac-4e7f-4b00-9178-d31a66827c86 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:21.243536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd0c39-07c8-4709-9bf0-6a6fc8a7fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:21.244221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd0c39-07c8-4709-9bf0-6a6fc8a7fd1d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:21.244501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd0c39-07c8-4709-9bf0-6a6fc8a7fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:21.244774 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd0c39-07c8-4709-9bf0-6a6fc8a7fd1d None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:21.245515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd0c39-07c8-4709-9bf0-6a6fc8a7fd1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:21.245816 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd0c39-07c8-4709-9bf0-6a6fc8a7fd1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:21.247178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd0c39-07c8-4709-9bf0-6a6fc8a7fd1d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:21.255535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 577/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:57:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:21.261232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae4138-a35a-468d-a372-f82d723fecdd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:21.360143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae4138-a35a-468d-a372-f82d723fecdd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:21.391651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5f7f1-aab8-45e5-89ad-272cdc43faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:21.392537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5f7f1-aab8-45e5-89ad-272cdc43faf2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:21.392821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5f7f1-aab8-45e5-89ad-272cdc43faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:21.393100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5f7f1-aab8-45e5-89ad-272cdc43faf2 None admin] PATH_INFO: `/v3/users/86172e62ed6841e4b6a17a90f9a2a6f6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:21.394297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5f7f1-aab8-45e5-89ad-272cdc43faf2 None admin] RBAC: Authorizing `identity:get_user(user_id=86172e62ed6841e4b6a17a90f9a2a6f6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:21.395716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5f7f1-aab8-45e5-89ad-272cdc43faf2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:21.397366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 581/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:21 2022] GET /identity/v3/users/86172e62ed6841e4b6a17a90f9a2a6f6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:21.403100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd0c39-07c8-4709-9bf0-6a6fc8a7fd1d None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:21.497540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:21.501171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd0c39-07c8-4709-9bf0-6a6fc8a7fd1d None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:21.535691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456ff93-413d-40fa-bdc5-97dc2b9b6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:21.536381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456ff93-413d-40fa-bdc5-97dc2b9b6945 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:21.536666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456ff93-413d-40fa-bdc5-97dc2b9b6945 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:21.536940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456ff93-413d-40fa-bdc5-97dc2b9b6945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:21.602413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456ff93-413d-40fa-bdc5-97dc2b9b6945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:21.603859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456ff93-413d-40fa-bdc5-97dc2b9b6945 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:21.695135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:21.698562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 578/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:57:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:21.705158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5f7f1-aab8-45e5-89ad-272cdc43faf2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:21.761893 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:21.803031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5f7f1-aab8-45e5-89ad-272cdc43faf2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:21.835473 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e3237-83c2-4c14-a88a-515bbc5fec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:21.836344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3237-83c2-4c14-a88a-515bbc5fec66 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:21.836629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3237-83c2-4c14-a88a-515bbc5fec66 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:21.836902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3237-83c2-4c14-a88a-515bbc5fec66 None admin] PATH_INFO: `/v3/projects/af59bf3199794a0da73fe883a2942df8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:21.838071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3237-83c2-4c14-a88a-515bbc5fec66 None admin] RBAC: Authorizing `identity:get_project(project_id=af59bf3199794a0da73fe883a2942df8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:21.839495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3237-83c2-4c14-a88a-515bbc5fec66 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:21.841196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 582/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:57:21 2022] GET /identity/v3/projects/af59bf3199794a0da73fe883a2942df8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:21.848060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456ff93-413d-40fa-bdc5-97dc2b9b6945 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:21.943687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456ff93-413d-40fa-bdc5-97dc2b9b6945 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:21.976717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475c722-71f3-4a88-b2a6-5841e215da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:21.977297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475c722-71f3-4a88-b2a6-5841e215da90 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:21.977579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475c722-71f3-4a88-b2a6-5841e215da90 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:21.977848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475c722-71f3-4a88-b2a6-5841e215da90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:21.978669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475c722-71f3-4a88-b2a6-5841e215da90 None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=af59bf3199794a0da73fe883a2942df8, user.id=86172e62ed6841e4b6a17a90f9a2a6f6) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:21.978975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475c722-71f3-4a88-b2a6-5841e215da90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:21.980432 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475c722-71f3-4a88-b2a6-5841e215da90 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:21.986077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 579/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:57:21 2022] GET /identity/v3/role_assignments?user.id=86172e62ed6841e4b6a17a90f9a2a6f6&scope.project.id=af59bf3199794a0da73fe883a2942df8&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:24.013598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2000a6-a534-438f-b135-c924ce5d9dd4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:24.014125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2000a6-a534-438f-b135-c924ce5d9dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:24.014125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2000a6-a534-438f-b135-c924ce5d9dd4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:24.016104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 583/1162] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:24.021265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b728-e019-4f30-af64-b328acfb6cd4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:24.021644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b728-e019-4f30-af64-b328acfb6cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:24.021815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b728-e019-4f30-af64-b328acfb6cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:24.038928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1a22b728-e019-4f30-af64-b328acfb6cd4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:24.040133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1a22b728-e019-4f30-af64-b328acfb6cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:24.096296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:24.104554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 580/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:24.126848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2000a6-a534-438f-b135-c924ce5d9dd4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:24.226026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2000a6-a534-438f-b135-c924ce5d9dd4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:24.251651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:24.260036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8fdaf-949d-4935-9ca5-fd31701f9cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:24.260679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8fdaf-949d-4935-9ca5-fd31701f9cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:24.260964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8fdaf-949d-4935-9ca5-fd31701f9cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:24.261242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8fdaf-949d-4935-9ca5-fd31701f9cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:24.325820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8fdaf-949d-4935-9ca5-fd31701f9cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:24.327256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8fdaf-949d-4935-9ca5-fd31701f9cf3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:24.421600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 584/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:57:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:24.427689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b728-e019-4f30-af64-b328acfb6cd4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:24.524445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b728-e019-4f30-af64-b328acfb6cd4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:24.556815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326cec9-9dce-45e0-9e88-3d64a93b84e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:24.557606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326cec9-9dce-45e0-9e88-3d64a93b84e0 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:24.557919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326cec9-9dce-45e0-9e88-3d64a93b84e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:24.558194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326cec9-9dce-45e0-9e88-3d64a93b84e0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:24.565264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326cec9-9dce-45e0-9e88-3d64a93b84e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:24.566697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326cec9-9dce-45e0-9e88-3d64a93b84e0 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-b326cec9-9dce-45e0-9e88-3d64a93b84e0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:57:24.580963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:57:24.582139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:57:24.583006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 581/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:57:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:57:24.588135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8fdaf-949d-4935-9ca5-fd31701f9cf3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:24.614746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:24.684071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8fdaf-949d-4935-9ca5-fd31701f9cf3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:24.716843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100d3f-1349-47ac-b626-7b4a7d9b2225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:24.717494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100d3f-1349-47ac-b626-7b4a7d9b2225 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:24.717777 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100d3f-1349-47ac-b626-7b4a7d9b2225 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:24.718055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100d3f-1349-47ac-b626-7b4a7d9b2225 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:24.718910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100d3f-1349-47ac-b626-7b4a7d9b2225 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:24.719215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100d3f-1349-47ac-b626-7b4a7d9b2225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:24.720610 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100d3f-1349-47ac-b626-7b4a7d9b2225 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:24.728010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 585/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Tue Jun 28 11:57:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:26.724210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288483-a0a4-45a7-ad69-35ac8444ad16 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:26.724746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288483-a0a4-45a7-ad69-35ac8444ad16 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:26.724746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce288483-a0a4-45a7-ad69-35ac8444ad16 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:26.726148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 582/1167] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:26.731243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a205755-8121-4d70-9952-df414bc1fa43 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:26.731606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a205755-8121-4d70-9952-df414bc1fa43 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:26.731801 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a205755-8121-4d70-9952-df414bc1fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:26.748182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1a205755-8121-4d70-9952-df414bc1fa43 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:26.749884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a205755-8121-4d70-9952-df414bc1fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:26.814235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 586/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:26.837533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce288483-a0a4-45a7-ad69-35ac8444ad16 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:26.894493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:26.939306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce288483-a0a4-45a7-ad69-35ac8444ad16 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:26.970859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd7f92-22a4-41b9-898a-c4a6128796a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:26.971514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd7f92-22a4-41b9-898a-c4a6128796a4 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:26.971800 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd7f92-22a4-41b9-898a-c4a6128796a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:26.972105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd7f92-22a4-41b9-898a-c4a6128796a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:26.972842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd7f92-22a4-41b9-898a-c4a6128796a4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:26.974469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd7f92-22a4-41b9-898a-c4a6128796a4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:27.032066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 583/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Tue Jun 28 11:57:26 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:57:29.078512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cef597-16fb-41f2-87dd-bed8f4f389aa None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:29.079106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cef597-16fb-41f2-87dd-bed8f4f389aa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:29.079106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cef597-16fb-41f2-87dd-bed8f4f389aa None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:29.080472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 587/1170] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:29.085559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8aa4-0128-4439-8740-2e5a8e5c028e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:29.085947 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8aa4-0128-4439-8740-2e5a8e5c028e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:29.086114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b8aa4-0128-4439-8740-2e5a8e5c028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:29.102667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2b2b8aa4-0128-4439-8740-2e5a8e5c028e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:29.103840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2b2b8aa4-0128-4439-8740-2e5a8e5c028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:29.167077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 584/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:29.191206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cef597-16fb-41f2-87dd-bed8f4f389aa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:29.212017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:29.287352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cef597-16fb-41f2-87dd-bed8f4f389aa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:29.321844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85216fed-fdcd-4c37-8ebc-24f05c089769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:29.322694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85216fed-fdcd-4c37-8ebc-24f05c089769 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:29.322974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85216fed-fdcd-4c37-8ebc-24f05c089769 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:29.323247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85216fed-fdcd-4c37-8ebc-24f05c089769 None admin] PATH_INFO: `/v3/domains/e74671f5de9e4e2ab1a5711312942f52` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:29.334785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85216fed-fdcd-4c37-8ebc-24f05c089769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e74671f5de9e4e2ab1a5711312942f52)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:29.336174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85216fed-fdcd-4c37-8ebc-24f05c089769 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:29.337797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 588/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Tue Jun 28 11:57:29 2022] GET /identity/v3/domains/e74671f5de9e4e2ab1a5711312942f52 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:29.343619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b8aa4-0128-4439-8740-2e5a8e5c028e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:29.387797 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:29.439757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b8aa4-0128-4439-8740-2e5a8e5c028e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:29.472611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484e7b4-a098-45d4-a059-9b1e9b716bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:29.473526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484e7b4-a098-45d4-a059-9b1e9b716bfb None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:29.473806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484e7b4-a098-45d4-a059-9b1e9b716bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:29.474077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484e7b4-a098-45d4-a059-9b1e9b716bfb None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:29.474789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484e7b4-a098-45d4-a059-9b1e9b716bfb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:29.476314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484e7b4-a098-45d4-a059-9b1e9b716bfb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:29.558145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 585/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:57:29 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:57:31.598213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631623-2fa2-47e6-83b0-686dc1f74d4d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:31.598739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631623-2fa2-47e6-83b0-686dc1f74d4d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:31.598843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631623-2fa2-47e6-83b0-686dc1f74d4d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:31.600177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 589/1174] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:31.605396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a664d-8ec2-45a2-b76b-830daf522af9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:31.605828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a664d-8ec2-45a2-b76b-830daf522af9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:31.605930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a664d-8ec2-45a2-b76b-830daf522af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:31.622295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ca4a664d-8ec2-45a2-b76b-830daf522af9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:31.623460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ca4a664d-8ec2-45a2-b76b-830daf522af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:31.687042 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 586/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:31.711922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631623-2fa2-47e6-83b0-686dc1f74d4d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:31.792177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:31.810879 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631623-2fa2-47e6-83b0-686dc1f74d4d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:31.844988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5a590-e7c4-4720-8e6d-238143ef6762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:31.845834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5a590-e7c4-4720-8e6d-238143ef6762 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:31.846113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5a590-e7c4-4720-8e6d-238143ef6762 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:31.846383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5a590-e7c4-4720-8e6d-238143ef6762 None admin] PATH_INFO: `/v3/domains/e74671f5de9e4e2ab1a5711312942f52` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:31.847546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5a590-e7c4-4720-8e6d-238143ef6762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e74671f5de9e4e2ab1a5711312942f52)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:31.849257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5a590-e7c4-4720-8e6d-238143ef6762 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:31.850840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 590/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Tue Jun 28 11:57:31 2022] GET /identity/v3/domains/e74671f5de9e4e2ab1a5711312942f52 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:31.856498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a664d-8ec2-45a2-b76b-830daf522af9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:31.882725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:31.952848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a664d-8ec2-45a2-b76b-830daf522af9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:31.984979 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8a63-077b-4794-b247-1749a8d51d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:31.985632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8a63-077b-4794-b247-1749a8d51d69 None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:31.985916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8a63-077b-4794-b247-1749a8d51d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:31.986194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8a63-077b-4794-b247-1749a8d51d69 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:31.986892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8a63-077b-4794-b247-1749a8d51d69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:31.988356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8a63-077b-4794-b247-1749a8d51d69 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:32.070937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 587/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:57:31 2022] POST /identity/v3/users => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:57:34.162313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec02ec-9bec-49d3-b80f-f8d1383f7207 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:34.162862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec02ec-9bec-49d3-b80f-f8d1383f7207 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:34.162862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec02ec-9bec-49d3-b80f-f8d1383f7207 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:34.164301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 591/1178] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:34.169712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7009-3a90-4347-983f-e8e93b579a69 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:34.170135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7009-3a90-4347-983f-e8e93b579a69 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:34.170276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7009-3a90-4347-983f-e8e93b579a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:34.189446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7a1a7009-3a90-4347-983f-e8e93b579a69 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:34.190648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7a1a7009-3a90-4347-983f-e8e93b579a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:34.255402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 588/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:34.278832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec02ec-9bec-49d3-b80f-f8d1383f7207 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:34.377245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec02ec-9bec-49d3-b80f-f8d1383f7207 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:34.410458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95642060-2a52-44c9-9656-46252b5fdf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:34.411237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95642060-2a52-44c9-9656-46252b5fdf60 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:34.411521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95642060-2a52-44c9-9656-46252b5fdf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:34.411796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95642060-2a52-44c9-9656-46252b5fdf60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:34.421583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95642060-2a52-44c9-9656-46252b5fdf60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-95642060-2a52-44c9-9656-46252b5fdf60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:57:34.429048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:57:34.430213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:57:34.431155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 592/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:57:34.436287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a7009-3a90-4347-983f-e8e93b579a69 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:34.450433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:34.536335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a7009-3a90-4347-983f-e8e93b579a69 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:34.569120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d73338-9af7-4b95-81c0-9a220e7447d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:34.569773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d73338-9af7-4b95-81c0-9a220e7447d1 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:34.570051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d73338-9af7-4b95-81c0-9a220e7447d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:34.570319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d73338-9af7-4b95-81c0-9a220e7447d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:34.571055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d73338-9af7-4b95-81c0-9a220e7447d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:34.571357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d73338-9af7-4b95-81c0-9a220e7447d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:34.572747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d73338-9af7-4b95-81c0-9a220e7447d1 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:34.580994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 589/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:34.586654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95642060-2a52-44c9-9656-46252b5fdf60 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:34.598669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:34.683926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95642060-2a52-44c9-9656-46252b5fdf60 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:34.715652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa89d6-581a-438e-a9c5-23e98788503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:34.716531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa89d6-581a-438e-a9c5-23e98788503a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:34.716813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa89d6-581a-438e-a9c5-23e98788503a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:34.717085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa89d6-581a-438e-a9c5-23e98788503a None admin] PATH_INFO: `/v3/users/ec42afc98b834de6af4181c6ecdea7cd` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:34.730454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa89d6-581a-438e-a9c5-23e98788503a None admin] RBAC: Authorizing `identity:get_user(user_id=ec42afc98b834de6af4181c6ecdea7cd)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:34.731901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa89d6-581a-438e-a9c5-23e98788503a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:34.733649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 593/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:34 2022] GET /identity/v3/users/ec42afc98b834de6af4181c6ecdea7cd => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:34.739258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d73338-9af7-4b95-81c0-9a220e7447d1 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:34.811263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:34.835162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d73338-9af7-4b95-81c0-9a220e7447d1 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:34.867207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4028e9-116e-4535-9752-e8771e95a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:34.867839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4028e9-116e-4535-9752-e8771e95a504 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:34.868149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4028e9-116e-4535-9752-e8771e95a504 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:34.868428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4028e9-116e-4535-9752-e8771e95a504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:34.931834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4028e9-116e-4535-9752-e8771e95a504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:34.933292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4028e9-116e-4535-9752-e8771e95a504 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:35.002583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:35.026412 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 590/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:57:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:35.032309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa89d6-581a-438e-a9c5-23e98788503a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:35.095443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:35.128485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa89d6-581a-438e-a9c5-23e98788503a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:35.161094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9bb38-2d4d-4b7d-9c43-e0d5842d02f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:35.161936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9bb38-2d4d-4b7d-9c43-e0d5842d02f5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:35.162214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9bb38-2d4d-4b7d-9c43-e0d5842d02f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:35.162489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9bb38-2d4d-4b7d-9c43-e0d5842d02f5 None admin] PATH_INFO: `/v3/projects/5572ab55ca0548f4b5e4c4bec6570732` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:35.163693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9bb38-2d4d-4b7d-9c43-e0d5842d02f5 None admin] RBAC: Authorizing `identity:get_project(project_id=5572ab55ca0548f4b5e4c4bec6570732)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:35.165145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9bb38-2d4d-4b7d-9c43-e0d5842d02f5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:35.166809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 594/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:57:35 2022] GET /identity/v3/projects/5572ab55ca0548f4b5e4c4bec6570732 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:35.173413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4028e9-116e-4535-9752-e8771e95a504 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:35.272539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4028e9-116e-4535-9752-e8771e95a504 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:35.306011 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c7159-4e50-483c-874a-9fbedc2c6bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:35.306654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c7159-4e50-483c-874a-9fbedc2c6bde None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:35.306940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c7159-4e50-483c-874a-9fbedc2c6bde None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:35.307215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c7159-4e50-483c-874a-9fbedc2c6bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:35.308070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c7159-4e50-483c-874a-9fbedc2c6bde None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=5572ab55ca0548f4b5e4c4bec6570732, user.id=ec42afc98b834de6af4181c6ecdea7cd) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:35.308382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c7159-4e50-483c-874a-9fbedc2c6bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:35.309812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c7159-4e50-483c-874a-9fbedc2c6bde None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:35.315579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 591/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:57:35 2022] GET /identity/v3/role_assignments?user.id=ec42afc98b834de6af4181c6ecdea7cd&scope.project.id=5572ab55ca0548f4b5e4c4bec6570732&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:37.302524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928b5cc-810b-44f7-8b1c-cb9d5c5e8914 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:37.303082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928b5cc-810b-44f7-8b1c-cb9d5c5e8914 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:37.303215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928b5cc-810b-44f7-8b1c-cb9d5c5e8914 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:37.304654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 595/1186] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:37.309725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c64b-7998-47f8-a5d2-2bb515a07bcd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:37.310154 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c64b-7998-47f8-a5d2-2bb515a07bcd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:37.310279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c64b-7998-47f8-a5d2-2bb515a07bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:37.327089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ad25c64b-7998-47f8-a5d2-2bb515a07bcd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:37.328303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ad25c64b-7998-47f8-a5d2-2bb515a07bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:37.357289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:37.393296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 592/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:37.416680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928b5cc-810b-44f7-8b1c-cb9d5c5e8914 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:37.514107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928b5cc-810b-44f7-8b1c-cb9d5c5e8914 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:37.547849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f6b96-a133-4f28-bb48-ff944d6b862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:37.548651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f6b96-a133-4f28-bb48-ff944d6b862b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:37.548931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f6b96-a133-4f28-bb48-ff944d6b862b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:37.549203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f6b96-a133-4f28-bb48-ff944d6b862b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:37.551026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:37.560760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f6b96-a133-4f28-bb48-ff944d6b862b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a94f6b96-a133-4f28-bb48-ff944d6b862b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:57:37.567017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:57:37.568127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:57:37.569129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 596/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:57:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:57:37.574439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c64b-7998-47f8-a5d2-2bb515a07bcd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:37.670025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c64b-7998-47f8-a5d2-2bb515a07bcd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:37.703461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32f19c-15d2-4abf-bba8-9c50a266bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:37.704148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32f19c-15d2-4abf-bba8-9c50a266bd54 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:37.704427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32f19c-15d2-4abf-bba8-9c50a266bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:37.704698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32f19c-15d2-4abf-bba8-9c50a266bd54 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:37.705441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32f19c-15d2-4abf-bba8-9c50a266bd54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:37.705747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32f19c-15d2-4abf-bba8-9c50a266bd54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:37.707125 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32f19c-15d2-4abf-bba8-9c50a266bd54 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:37.715133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 593/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:57:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:37.721711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f6b96-a133-4f28-bb48-ff944d6b862b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:37.818233 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f6b96-a133-4f28-bb48-ff944d6b862b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:37.851227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae11de-642e-4f5c-a3ae-4b7b356d10e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:37.852115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae11de-642e-4f5c-a3ae-4b7b356d10e5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:37.852401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae11de-642e-4f5c-a3ae-4b7b356d10e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:37.852678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae11de-642e-4f5c-a3ae-4b7b356d10e5 None admin] PATH_INFO: `/v3/users/ec42afc98b834de6af4181c6ecdea7cd` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:37.853863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae11de-642e-4f5c-a3ae-4b7b356d10e5 None admin] RBAC: Authorizing `identity:get_user(user_id=ec42afc98b834de6af4181c6ecdea7cd)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:37.855285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae11de-642e-4f5c-a3ae-4b7b356d10e5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:37.856936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 597/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:37 2022] GET /identity/v3/users/ec42afc98b834de6af4181c6ecdea7cd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:37.863111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32f19c-15d2-4abf-bba8-9c50a266bd54 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:37.893662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:37.959124 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32f19c-15d2-4abf-bba8-9c50a266bd54 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:37.990950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ce71d-92c0-41ff-b3dc-c3bbea499bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:37.991793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ce71d-92c0-41ff-b3dc-c3bbea499bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:37.992099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ce71d-92c0-41ff-b3dc-c3bbea499bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:37.992370 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ce71d-92c0-41ff-b3dc-c3bbea499bf4 None admin] PATH_INFO: `/v3/projects/5572ab55ca0548f4b5e4c4bec6570732` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:37.993525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ce71d-92c0-41ff-b3dc-c3bbea499bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=5572ab55ca0548f4b5e4c4bec6570732)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:37.994950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ce71d-92c0-41ff-b3dc-c3bbea499bf4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:37.996644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 594/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:57:37 2022] GET /identity/v3/projects/5572ab55ca0548f4b5e4c4bec6570732 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:38.003077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae11de-642e-4f5c-a3ae-4b7b356d10e5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:38.062924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:38.100406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae11de-642e-4f5c-a3ae-4b7b356d10e5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:38.132437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aaa21-9d87-4dbd-9665-a71fffc72776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:38.133315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aaa21-9d87-4dbd-9665-a71fffc72776 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:38.133598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aaa21-9d87-4dbd-9665-a71fffc72776 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:38.133873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aaa21-9d87-4dbd-9665-a71fffc72776 None admin] PATH_INFO: `/v3/projects/5572ab55ca0548f4b5e4c4bec6570732/users/ec42afc98b834de6af4181c6ecdea7cd/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:38.135811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aaa21-9d87-4dbd-9665-a71fffc72776 None admin] RBAC: Authorizing `identity:create_grant(project_id=5572ab55ca0548f4b5e4c4bec6570732, user_id=ec42afc98b834de6af4181c6ecdea7cd, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:38.137261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aaa21-9d87-4dbd-9665-a71fffc72776 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:38.259784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 598/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:57:38 2022] PUT /identity/v3/projects/5572ab55ca0548f4b5e4c4bec6570732/users/ec42afc98b834de6af4181c6ecdea7cd/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:57:40.251305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e9b0-9a3d-4292-9cbc-6f6696a18007 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:40.251837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e9b0-9a3d-4292-9cbc-6f6696a18007 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:40.251837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e9b0-9a3d-4292-9cbc-6f6696a18007 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:40.253239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 595/1193] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:57:40.258288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919add20-95a3-4bae-a819-12e81b0476e2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:40.258680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919add20-95a3-4bae-a819-12e81b0476e2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:40.258851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919add20-95a3-4bae-a819-12e81b0476e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:40.275224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-919add20-95a3-4bae-a819-12e81b0476e2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:57:40.276435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-919add20-95a3-4bae-a819-12e81b0476e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:57:40.340679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 599/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:57:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:57:40.364645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e9b0-9a3d-4292-9cbc-6f6696a18007 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:40.459574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:40.464231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e9b0-9a3d-4292-9cbc-6f6696a18007 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:40.499639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7230c-5b77-4d59-9dc6-76731e7a07df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:40.500464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7230c-5b77-4d59-9dc6-76731e7a07df None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:40.500749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7230c-5b77-4d59-9dc6-76731e7a07df None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:40.501025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7230c-5b77-4d59-9dc6-76731e7a07df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:40.511306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7230c-5b77-4d59-9dc6-76731e7a07df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-74c7230c-5b77-4d59-9dc6-76731e7a07df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:57:40.520188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:57:40.521289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:57:40.522236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 596/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:57:40.527562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919add20-95a3-4bae-a819-12e81b0476e2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:40.580396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:40.624951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919add20-95a3-4bae-a819-12e81b0476e2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:40.658642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa45d88-03b5-434d-a63a-ee9799a8a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:40.659297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45d88-03b5-434d-a63a-ee9799a8a519 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:40.659581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45d88-03b5-434d-a63a-ee9799a8a519 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:40.659855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa45d88-03b5-434d-a63a-ee9799a8a519 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:40.660633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa45d88-03b5-434d-a63a-ee9799a8a519 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:40.660940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa45d88-03b5-434d-a63a-ee9799a8a519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:40.662294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa45d88-03b5-434d-a63a-ee9799a8a519 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:40.670730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 600/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:40.676624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7230c-5b77-4d59-9dc6-76731e7a07df None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:40.774164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7230c-5b77-4d59-9dc6-76731e7a07df None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:40.805815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233ebbe-b528-4d21-b45b-79a1bcefbb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:40.806669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233ebbe-b528-4d21-b45b-79a1bcefbb86 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:40.806957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233ebbe-b528-4d21-b45b-79a1bcefbb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:40.807233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233ebbe-b528-4d21-b45b-79a1bcefbb86 None admin] PATH_INFO: `/v3/users/ec42afc98b834de6af4181c6ecdea7cd` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:40.808434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233ebbe-b528-4d21-b45b-79a1bcefbb86 None admin] RBAC: Authorizing `identity:get_user(user_id=ec42afc98b834de6af4181c6ecdea7cd)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:40.809861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233ebbe-b528-4d21-b45b-79a1bcefbb86 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:40.811997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 597/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Tue Jun 28 11:57:40 2022] GET /identity/v3/users/ec42afc98b834de6af4181c6ecdea7cd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:40.817587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa45d88-03b5-434d-a63a-ee9799a8a519 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:40.914026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa45d88-03b5-434d-a63a-ee9799a8a519 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:40.926987 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:40.946502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b7e8d-3ed0-4343-a945-43174fb3c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:40.947131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b7e8d-3ed0-4343-a945-43174fb3c5bb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:40.947414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b7e8d-3ed0-4343-a945-43174fb3c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:40.947687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b7e8d-3ed0-4343-a945-43174fb3c5bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:41.011913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b7e8d-3ed0-4343-a945-43174fb3c5bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:41.013335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b7e8d-3ed0-4343-a945-43174fb3c5bb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:41.107132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 601/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:57:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:57:41.113548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233ebbe-b528-4d21-b45b-79a1bcefbb86 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:41.141065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:41.210418 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233ebbe-b528-4d21-b45b-79a1bcefbb86 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:41.242894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960df634-2eb4-4496-80b5-0117ee3cd487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:41.243731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960df634-2eb4-4496-80b5-0117ee3cd487 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:41.244037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960df634-2eb4-4496-80b5-0117ee3cd487 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:41.244308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960df634-2eb4-4496-80b5-0117ee3cd487 None admin] PATH_INFO: `/v3/projects/5572ab55ca0548f4b5e4c4bec6570732` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:41.245461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960df634-2eb4-4496-80b5-0117ee3cd487 None admin] RBAC: Authorizing `identity:get_project(project_id=5572ab55ca0548f4b5e4c4bec6570732)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:41.246886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960df634-2eb4-4496-80b5-0117ee3cd487 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:41.248610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 598/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Tue Jun 28 11:57:41 2022] GET /identity/v3/projects/5572ab55ca0548f4b5e4c4bec6570732 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:41.254502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b7e8d-3ed0-4343-a945-43174fb3c5bb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:57:41.269442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:41.350917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b7e8d-3ed0-4343-a945-43174fb3c5bb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:57:41.384955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76b18-6828-4fbf-891b-0f0ca6497b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:57:41.385539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76b18-6828-4fbf-891b-0f0ca6497b3d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:57:41.385824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76b18-6828-4fbf-891b-0f0ca6497b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:57:41.386102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76b18-6828-4fbf-891b-0f0ca6497b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:57:41.386929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76b18-6828-4fbf-891b-0f0ca6497b3d None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=5572ab55ca0548f4b5e4c4bec6570732, user.id=ec42afc98b834de6af4181c6ecdea7cd) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:57:41.387242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76b18-6828-4fbf-891b-0f0ca6497b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:57:41.388720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76b18-6828-4fbf-891b-0f0ca6497b3d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:57:41.395597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 602/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:57:41 2022] GET /identity/v3/role_assignments?user.id=ec42afc98b834de6af4181c6ecdea7cd&scope.project.id=5572ab55ca0548f4b5e4c4bec6570732&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:57:51.238841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=53 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:57:51.392781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=61 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:51.903145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df051f-8e19-441f-aa59-e63921e8c5ad None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:51.903740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df051f-8e19-441f-aa59-e63921e8c5ad None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:51.903740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df051f-8e19-441f-aa59-e63921e8c5ad None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:51.905834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 599/1201] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:58:51.911025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87e598-6fae-44fb-af44-a3fa1f520bb5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:51.911463 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87e598-6fae-44fb-af44-a3fa1f520bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:51.911641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87e598-6fae-44fb-af44-a3fa1f520bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:51.929561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af87e598-6fae-44fb-af44-a3fa1f520bb5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:58:51.932469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af87e598-6fae-44fb-af44-a3fa1f520bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:58:51.995797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 603/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:58:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:58:52.020605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df051f-8e19-441f-aa59-e63921e8c5ad None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:52.123464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df051f-8e19-441f-aa59-e63921e8c5ad None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:52.156481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd97bf-ef10-4f83-88a1-44e28c07e0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:52.157198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd97bf-ef10-4f83-88a1-44e28c07e0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:52.157488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd97bf-ef10-4f83-88a1-44e28c07e0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:52.157785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd97bf-ef10-4f83-88a1-44e28c07e0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:52.168730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd97bf-ef10-4f83-88a1-44e28c07e0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:52.170806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd97bf-ef10-4f83-88a1-44e28c07e0d6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-8bdd97bf-ef10-4f83-88a1-44e28c07e0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:58:52.187493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:58:52.188646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:58:52.189753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:58:52.189753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:58:52.189753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:58:52.189753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:58:52.189753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 600/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:58:52.194881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87e598-6fae-44fb-af44-a3fa1f520bb5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:52.294688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87e598-6fae-44fb-af44-a3fa1f520bb5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:52.322452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:52.328701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c2ab6-5296-4083-bb22-abd795b89f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:52.329396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c2ab6-5296-4083-bb22-abd795b89f89 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:52.329676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c2ab6-5296-4083-bb22-abd795b89f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:52.329944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c2ab6-5296-4083-bb22-abd795b89f89 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:52.330660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c2ab6-5296-4083-bb22-abd795b89f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:52.330961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c2ab6-5296-4083-bb22-abd795b89f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:52.332363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c2ab6-5296-4083-bb22-abd795b89f89 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:52.343983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 604/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:52.349909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd97bf-ef10-4f83-88a1-44e28c07e0d6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:52.403213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:52.449241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd97bf-ef10-4f83-88a1-44e28c07e0d6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:52.482982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f812ab4-fc6a-4c05-a1ce-c6900b91b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:52.483710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f812ab4-fc6a-4c05-a1ce-c6900b91b75f None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:52.484049 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f812ab4-fc6a-4c05-a1ce-c6900b91b75f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:52.484330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f812ab4-fc6a-4c05-a1ce-c6900b91b75f None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:52.492385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f812ab4-fc6a-4c05-a1ce-c6900b91b75f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:52.492385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f812ab4-fc6a-4c05-a1ce-c6900b91b75f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:52.577069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 601/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Tue Jun 28 11:58:52 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:58:54.622819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76c004-42bc-45db-92d3-baeef3c4b532 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:54.625057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76c004-42bc-45db-92d3-baeef3c4b532 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:54.625057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76c004-42bc-45db-92d3-baeef3c4b532 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:54.625057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 605/1206] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:58:54.630144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e2e9-fc05-4f25-be13-2560b0637049 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:54.630607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e2e9-fc05-4f25-be13-2560b0637049 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:54.630708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e2e9-fc05-4f25-be13-2560b0637049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:54.647854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8894e2e9-fc05-4f25-be13-2560b0637049 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:58:54.653944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8894e2e9-fc05-4f25-be13-2560b0637049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:58:54.713728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 602/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:58:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:58:54.739435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76c004-42bc-45db-92d3-baeef3c4b532 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:54.843925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76c004-42bc-45db-92d3-baeef3c4b532 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:54.877276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cc4fc-01bc-4ea7-8092-ad8ff585d5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:54.878068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cc4fc-01bc-4ea7-8092-ad8ff585d5ef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:54.878352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cc4fc-01bc-4ea7-8092-ad8ff585d5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:54.878629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cc4fc-01bc-4ea7-8092-ad8ff585d5ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:54.888576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cc4fc-01bc-4ea7-8092-ad8ff585d5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4b8cc4fc-01bc-4ea7-8092-ad8ff585d5ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:58:54.896906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:58:54.900441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:58:54.901519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 606/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:58:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:58:54.904108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e2e9-fc05-4f25-be13-2560b0637049 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:54.943781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:55.000863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e2e9-fc05-4f25-be13-2560b0637049 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:55.034746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4e829-1ed0-4d71-9527-c48e71fd18ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:55.035409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e829-1ed0-4d71-9527-c48e71fd18ec None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:55.035689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e829-1ed0-4d71-9527-c48e71fd18ec None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:55.035990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e829-1ed0-4d71-9527-c48e71fd18ec None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:55.036732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4e829-1ed0-4d71-9527-c48e71fd18ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:55.037036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4e829-1ed0-4d71-9527-c48e71fd18ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:55.038411 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4e829-1ed0-4d71-9527-c48e71fd18ec None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:55.046861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 603/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:58:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:55.052633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cc4fc-01bc-4ea7-8092-ad8ff585d5ef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:55.103864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:55.152754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cc4fc-01bc-4ea7-8092-ad8ff585d5ef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:55.185420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0c8fe-18ca-4cdc-bade-ddbe7daa1762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:55.186871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0c8fe-18ca-4cdc-bade-ddbe7daa1762 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:55.187163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0c8fe-18ca-4cdc-bade-ddbe7daa1762 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:55.187440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0c8fe-18ca-4cdc-bade-ddbe7daa1762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:55.197777 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0c8fe-18ca-4cdc-bade-ddbe7daa1762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:55.199196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0c8fe-18ca-4cdc-bade-ddbe7daa1762 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-61d0c8fe-18ca-4cdc-bade-ddbe7daa1762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:58:55.216535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:58:55.217680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:58:55.218785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:58:55.218785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:58:55.218785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:58:55.218785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:58:55.218785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 607/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:58:55.223829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4e829-1ed0-4d71-9527-c48e71fd18ec None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:55.319601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:55.322550 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4e829-1ed0-4d71-9527-c48e71fd18ec None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:55.356317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ea2fc-179c-41ed-8001-bb61e4852a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:55.356921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ea2fc-179c-41ed-8001-bb61e4852a82 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:55.357240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ea2fc-179c-41ed-8001-bb61e4852a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:55.357478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ea2fc-179c-41ed-8001-bb61e4852a82 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:55.358200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ea2fc-179c-41ed-8001-bb61e4852a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:55.358500 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ea2fc-179c-41ed-8001-bb61e4852a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:55.359902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ea2fc-179c-41ed-8001-bb61e4852a82 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:55.371319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 604/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:55.377237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0c8fe-18ca-4cdc-bade-ddbe7daa1762 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:55.483055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0c8fe-18ca-4cdc-bade-ddbe7daa1762 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:55.484677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:55.516490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d784499-0064-4584-9848-672ace7a3d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:55.517287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d784499-0064-4584-9848-672ace7a3d74 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:55.517571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d784499-0064-4584-9848-672ace7a3d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:55.517855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d784499-0064-4584-9848-672ace7a3d74 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:55.525314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d784499-0064-4584-9848-672ace7a3d74 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:55.526760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d784499-0064-4584-9848-672ace7a3d74 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4d784499-0064-4584-9848-672ace7a3d74 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:58:55.542118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:58:55.543315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:58:55.544514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 608/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:58:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:58:55.549208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ea2fc-179c-41ed-8001-bb61e4852a82 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:55.645545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ea2fc-179c-41ed-8001-bb61e4852a82 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:55.678127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd32b1-7f53-4964-9945-0cc1cb6a75f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:55.678781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd32b1-7f53-4964-9945-0cc1cb6a75f7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:55.679061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd32b1-7f53-4964-9945-0cc1cb6a75f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:55.679335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd32b1-7f53-4964-9945-0cc1cb6a75f7 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:55.680190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd32b1-7f53-4964-9945-0cc1cb6a75f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:55.680495 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd32b1-7f53-4964-9945-0cc1cb6a75f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:55.681921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd32b1-7f53-4964-9945-0cc1cb6a75f7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:55.700132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 605/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Jun 28 11:58:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:55.706376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d784499-0064-4584-9848-672ace7a3d74 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:55.803425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d784499-0064-4584-9848-672ace7a3d74 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:55.836776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008900c-dc53-4962-b08c-f6a2c2e4e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:55.837463 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008900c-dc53-4962-b08c-f6a2c2e4e974 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:55.837743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008900c-dc53-4962-b08c-f6a2c2e4e974 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:55.838015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008900c-dc53-4962-b08c-f6a2c2e4e974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:55.866548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:55.904908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008900c-dc53-4962-b08c-f6a2c2e4e974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:55.906290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008900c-dc53-4962-b08c-f6a2c2e4e974 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:56.001861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 609/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:58:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:58:56.007581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd32b1-7f53-4964-9945-0cc1cb6a75f7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:56.026892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:56.105284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd32b1-7f53-4964-9945-0cc1cb6a75f7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:56.139791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79bc86-9c6b-4e07-9106-57f1ef833cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:56.140606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79bc86-9c6b-4e07-9106-57f1ef833cac None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:56.140888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79bc86-9c6b-4e07-9106-57f1ef833cac None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:56.141163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79bc86-9c6b-4e07-9106-57f1ef833cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:56.150818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79bc86-9c6b-4e07-9106-57f1ef833cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:56.152306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79bc86-9c6b-4e07-9106-57f1ef833cac None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0a79bc86-9c6b-4e07-9106-57f1ef833cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:58:56.169118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:58:56.171269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:58:56.172257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:58:56.172257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:58:56.172257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:58:56.172257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:58:56.172257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 606/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:58:56.176527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008900c-dc53-4962-b08c-f6a2c2e4e974 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:56.237821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:56.276823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008900c-dc53-4962-b08c-f6a2c2e4e974 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:56.310231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ab293-78e4-4860-9a3d-d16bf6095920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:56.311945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ab293-78e4-4860-9a3d-d16bf6095920 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:56.311945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ab293-78e4-4860-9a3d-d16bf6095920 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:56.313951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ab293-78e4-4860-9a3d-d16bf6095920 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:56.313951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ab293-78e4-4860-9a3d-d16bf6095920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:56.313951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ab293-78e4-4860-9a3d-d16bf6095920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:56.314429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ab293-78e4-4860-9a3d-d16bf6095920 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:56.330767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 610/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:56.332014 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79bc86-9c6b-4e07-9106-57f1ef833cac None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:56.400293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:56.431557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79bc86-9c6b-4e07-9106-57f1ef833cac None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:56.465045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae6ce5-849d-4bbf-aade-0f87cfd896db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:56.465828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae6ce5-849d-4bbf-aade-0f87cfd896db None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:56.466201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae6ce5-849d-4bbf-aade-0f87cfd896db None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:56.466477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae6ce5-849d-4bbf-aade-0f87cfd896db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:56.473770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae6ce5-849d-4bbf-aade-0f87cfd896db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:56.475333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae6ce5-849d-4bbf-aade-0f87cfd896db None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-9dae6ce5-849d-4bbf-aade-0f87cfd896db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:58:56.489445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:58:56.491020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:58:56.492793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:58:56.492793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:58:56.492793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:58:56.492793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:58:56.492793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:58:56.492793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:58:56.492793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:58:56.492793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:58:56.492793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 607/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:58:56.498328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ab293-78e4-4860-9a3d-d16bf6095920 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:56.595809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ab293-78e4-4860-9a3d-d16bf6095920 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:56.617451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:56.629013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9830e93-2ab5-45bb-9f18-a2f3f5052962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:56.629667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9830e93-2ab5-45bb-9f18-a2f3f5052962 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:56.629952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9830e93-2ab5-45bb-9f18-a2f3f5052962 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:56.630228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9830e93-2ab5-45bb-9f18-a2f3f5052962 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:56.631057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9830e93-2ab5-45bb-9f18-a2f3f5052962 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:56.631366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9830e93-2ab5-45bb-9f18-a2f3f5052962 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:56.632884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9830e93-2ab5-45bb-9f18-a2f3f5052962 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:56.646341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 611/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:56.652287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae6ce5-849d-4bbf-aade-0f87cfd896db None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:56.751296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae6ce5-849d-4bbf-aade-0f87cfd896db None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:56.778588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:56.784315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56bff4-7769-41cb-8f67-bff0e7b96596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:56.784956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56bff4-7769-41cb-8f67-bff0e7b96596 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:56.785236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56bff4-7769-41cb-8f67-bff0e7b96596 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:56.785509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56bff4-7769-41cb-8f67-bff0e7b96596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:56.786328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56bff4-7769-41cb-8f67-bff0e7b96596 None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=c7db581dec064fe0afeb4be5838470bf) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:56.786722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56bff4-7769-41cb-8f67-bff0e7b96596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:56.788179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56bff4-7769-41cb-8f67-bff0e7b96596 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:56.793402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 608/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:58:56 2022] GET /identity/v3/role_assignments?user.id=c7db581dec064fe0afeb4be5838470bf&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:58.838740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e716c-3d9b-4e6c-a33c-e6779e1d7313 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:58.839323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e716c-3d9b-4e6c-a33c-e6779e1d7313 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:58.839323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e716c-3d9b-4e6c-a33c-e6779e1d7313 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:58.840701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 612/1220] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:58:58.846767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3679f-566b-484e-adb2-969f410bcd96 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:58.847180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3679f-566b-484e-adb2-969f410bcd96 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:58.847296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3679f-566b-484e-adb2-969f410bcd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:58.864257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-aec3679f-566b-484e-adb2-969f410bcd96 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:58:58.865427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aec3679f-566b-484e-adb2-969f410bcd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:58:58.930294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 609/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:58:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:58:58.953008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e716c-3d9b-4e6c-a33c-e6779e1d7313 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:59.054215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e716c-3d9b-4e6c-a33c-e6779e1d7313 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:59.086464 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3c7c9-e8ee-4082-a574-581ca6b1d2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:59.087244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3c7c9-e8ee-4082-a574-581ca6b1d2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:59.087523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3c7c9-e8ee-4082-a574-581ca6b1d2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:59.087795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3c7c9-e8ee-4082-a574-581ca6b1d2f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:59.098846 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3c7c9-e8ee-4082-a574-581ca6b1d2f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c3a3c7c9-e8ee-4082-a574-581ca6b1d2f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:58:59.106393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:58:59.107593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:58:59.108867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 613/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 11:58:59.113866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3679f-566b-484e-adb2-969f410bcd96 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:59.208018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3679f-566b-484e-adb2-969f410bcd96 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:59.231022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:59.241428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c724a-b11d-4b84-b65b-8ed3654a27bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:59.242081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c724a-b11d-4b84-b65b-8ed3654a27bc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:59.242361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c724a-b11d-4b84-b65b-8ed3654a27bc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:59.242629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c724a-b11d-4b84-b65b-8ed3654a27bc None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:59.243362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c724a-b11d-4b84-b65b-8ed3654a27bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:59.243663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c724a-b11d-4b84-b65b-8ed3654a27bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:59.245056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c724a-b11d-4b84-b65b-8ed3654a27bc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:59.252770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 610/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:58:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:59.258542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3c7c9-e8ee-4082-a574-581ca6b1d2f1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:59.301882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:59.358517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3c7c9-e8ee-4082-a574-581ca6b1d2f1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:59.392030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ad955-abdd-467a-9885-66e8d5cba9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:59.392847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ad955-abdd-467a-9885-66e8d5cba9fb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:59.393130 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ad955-abdd-467a-9885-66e8d5cba9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:59.393402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ad955-abdd-467a-9885-66e8d5cba9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:59.403068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ad955-abdd-467a-9885-66e8d5cba9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:59.405299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ad955-abdd-467a-9885-66e8d5cba9fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fc7ad955-abdd-467a-9885-66e8d5cba9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:58:59.422145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:58:59.423238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:58:59.424212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:58:59.424212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:58:59.424212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:58:59.424212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:58:59.424212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 614/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:58:59.429179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c724a-b11d-4b84-b65b-8ed3654a27bc None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:59.529195 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c724a-b11d-4b84-b65b-8ed3654a27bc None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:59.562239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e29c-f25b-440d-a542-30a0e0146a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:59.562890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e29c-f25b-440d-a542-30a0e0146a9e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:59.563174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e29c-f25b-440d-a542-30a0e0146a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:59.563446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4e29c-f25b-440d-a542-30a0e0146a9e None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:59.564190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4e29c-f25b-440d-a542-30a0e0146a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:59.564500 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4e29c-f25b-440d-a542-30a0e0146a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:59.565878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4e29c-f25b-440d-a542-30a0e0146a9e None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:59.577771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 611/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:59.583579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ad955-abdd-467a-9885-66e8d5cba9fb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:59.678358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:59.684898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ad955-abdd-467a-9885-66e8d5cba9fb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:59.719052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25195c2b-6037-49d5-9eb2-08ae07a25021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:59.720124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25195c2b-6037-49d5-9eb2-08ae07a25021 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:59.720410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25195c2b-6037-49d5-9eb2-08ae07a25021 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:59.720687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25195c2b-6037-49d5-9eb2-08ae07a25021 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:59.727505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25195c2b-6037-49d5-9eb2-08ae07a25021 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:59.729001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25195c2b-6037-49d5-9eb2-08ae07a25021 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-25195c2b-6037-49d5-9eb2-08ae07a25021 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:58:59.744300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:58:59.745483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:58:59.746484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 615/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:58:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:58:59.751853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e29c-f25b-440d-a542-30a0e0146a9e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:58:59.798427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:58:59.848009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4e29c-f25b-440d-a542-30a0e0146a9e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:58:59.881188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34def22d-4b03-4803-b295-f22b604601e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:58:59.881852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def22d-4b03-4803-b295-f22b604601e6 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:58:59.882132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def22d-4b03-4803-b295-f22b604601e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:58:59.882401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def22d-4b03-4803-b295-f22b604601e6 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:58:59.883276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34def22d-4b03-4803-b295-f22b604601e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:58:59.883636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34def22d-4b03-4803-b295-f22b604601e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:58:59.885277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34def22d-4b03-4803-b295-f22b604601e6 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:58:59.902133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 612/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Jun 28 11:58:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:58:59.907664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25195c2b-6037-49d5-9eb2-08ae07a25021 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:00.005992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25195c2b-6037-49d5-9eb2-08ae07a25021 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:00.037907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc842f4-d21b-4928-b58f-6e59db0ac0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:00.038682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc842f4-d21b-4928-b58f-6e59db0ac0af None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:00.038959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc842f4-d21b-4928-b58f-6e59db0ac0af None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:00.039231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc842f4-d21b-4928-b58f-6e59db0ac0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:00.049363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc842f4-d21b-4928-b58f-6e59db0ac0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:00.050806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc842f4-d21b-4928-b58f-6e59db0ac0af None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3cc842f4-d21b-4928-b58f-6e59db0ac0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:59:00.067973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:00.073941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:00.075055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:59:00.075055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:59:00.075055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:00.075055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:00.075055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 616/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:00.076760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34def22d-4b03-4803-b295-f22b604601e6 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:00.176728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34def22d-4b03-4803-b295-f22b604601e6 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:00.179017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:00.209000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b27f82-000d-479a-bc80-7f19b50bbedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:00.209660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b27f82-000d-479a-bc80-7f19b50bbedf None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:00.209936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b27f82-000d-479a-bc80-7f19b50bbedf None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:00.210209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b27f82-000d-479a-bc80-7f19b50bbedf None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:00.210923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b27f82-000d-479a-bc80-7f19b50bbedf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:00.211230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b27f82-000d-479a-bc80-7f19b50bbedf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:00.212620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b27f82-000d-479a-bc80-7f19b50bbedf None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:00.224194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 613/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:00.229881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc842f4-d21b-4928-b58f-6e59db0ac0af None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:00.239171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:00.327039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc842f4-d21b-4928-b58f-6e59db0ac0af None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:00.359894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb44d-65c3-4098-a7cf-386eeaa29dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:00.360671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb44d-65c3-4098-a7cf-386eeaa29dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:00.360946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb44d-65c3-4098-a7cf-386eeaa29dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:00.361212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbb44d-65c3-4098-a7cf-386eeaa29dd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:00.367853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb44d-65c3-4098-a7cf-386eeaa29dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:00.372758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbb44d-65c3-4098-a7cf-386eeaa29dd9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f3cbb44d-65c3-4098-a7cf-386eeaa29dd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:59:00.382868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:00.387492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:00.388716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:59:00.388716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:59:00.388716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:59:00.388716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:59:00.388716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:59:00.388716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:59:00.388716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:00.388716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:00.388716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 617/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:00.389973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b27f82-000d-479a-bc80-7f19b50bbedf None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:00.487368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b27f82-000d-479a-bc80-7f19b50bbedf None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:00.521979 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7f2a8-4504-465c-a29b-fa6392e78fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:00.522646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7f2a8-4504-465c-a29b-fa6392e78fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:00.522931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7f2a8-4504-465c-a29b-fa6392e78fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:00.523206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7f2a8-4504-465c-a29b-fa6392e78fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:00.524036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7f2a8-4504-465c-a29b-fa6392e78fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:00.524693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7f2a8-4504-465c-a29b-fa6392e78fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:00.525783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7f2a8-4504-465c-a29b-fa6392e78fd4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:00.538664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 614/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:00.544608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb44d-65c3-4098-a7cf-386eeaa29dd9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:00.610392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:00.643851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbb44d-65c3-4098-a7cf-386eeaa29dd9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:00.677640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ee625-de57-4691-84f8-0e68bbfbe65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:00.678527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee625-de57-4691-84f8-0e68bbfbe65d None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:00.678809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee625-de57-4691-84f8-0e68bbfbe65d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:00.679088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ee625-de57-4691-84f8-0e68bbfbe65d None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/c7db581dec064fe0afeb4be5838470bf/roles/4ebdbc7b2e0b4807a0ef679e0f061a53` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:00.693638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ee625-de57-4691-84f8-0e68bbfbe65d None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=c7db581dec064fe0afeb4be5838470bf, role_id=4ebdbc7b2e0b4807a0ef679e0f061a53)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:00.695087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ee625-de57-4691-84f8-0e68bbfbe65d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:00.771047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 618/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:59:00 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/c7db581dec064fe0afeb4be5838470bf/roles/4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:59:02.769486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a079f6-5f9c-445c-8b2f-5fa64a522b1f None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:02.770044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a079f6-5f9c-445c-8b2f-5fa64a522b1f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:02.770044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a079f6-5f9c-445c-8b2f-5fa64a522b1f None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:02.771443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 615/1233] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:59:02.776677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6eb85-f517-4113-9e6d-16a4445724f7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:02.777084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6eb85-f517-4113-9e6d-16a4445724f7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:02.777186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6eb85-f517-4113-9e6d-16a4445724f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:02.794011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-41f6eb85-f517-4113-9e6d-16a4445724f7 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:59:02.795224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41f6eb85-f517-4113-9e6d-16a4445724f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:59:02.861752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 619/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:59:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:59:02.884898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a079f6-5f9c-445c-8b2f-5fa64a522b1f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:02.911018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:02.983457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a079f6-5f9c-445c-8b2f-5fa64a522b1f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:03.016905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7f448-c1c9-4fe5-9da2-22caf2562b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:03.017694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7f448-c1c9-4fe5-9da2-22caf2562b9e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:03.017979 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7f448-c1c9-4fe5-9da2-22caf2562b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:03.018255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7f448-c1c9-4fe5-9da2-22caf2562b9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:03.028193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7f448-c1c9-4fe5-9da2-22caf2562b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-47e7f448-c1c9-4fe5-9da2-22caf2562b9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:59:03.037016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:03.037986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:03.038850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 616/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Tue Jun 28 11:59:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:03.044335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6eb85-f517-4113-9e6d-16a4445724f7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:03.089748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:03.149752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6eb85-f517-4113-9e6d-16a4445724f7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:03.184549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5687005-ed9d-4367-8c06-1db16a9abf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:03.185212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5687005-ed9d-4367-8c06-1db16a9abf05 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:03.185620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5687005-ed9d-4367-8c06-1db16a9abf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:03.185907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5687005-ed9d-4367-8c06-1db16a9abf05 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:03.186734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5687005-ed9d-4367-8c06-1db16a9abf05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:03.187044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5687005-ed9d-4367-8c06-1db16a9abf05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:03.188442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5687005-ed9d-4367-8c06-1db16a9abf05 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:03.196269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 620/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Tue Jun 28 11:59:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:03.202104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7f448-c1c9-4fe5-9da2-22caf2562b9e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:03.284618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:03.300273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7f448-c1c9-4fe5-9da2-22caf2562b9e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:03.331711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35763-78cb-415d-a82d-8c5221010693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:03.332516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35763-78cb-415d-a82d-8c5221010693 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:03.332812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35763-78cb-415d-a82d-8c5221010693 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:03.333069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35763-78cb-415d-a82d-8c5221010693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:03.343679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35763-78cb-415d-a82d-8c5221010693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:03.345423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35763-78cb-415d-a82d-8c5221010693 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-64e35763-78cb-415d-a82d-8c5221010693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:59:03.362332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:03.363389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:03.364363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:59:03.364363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:59:03.364363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:03.364363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:03.364363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 617/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:03.369193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5687005-ed9d-4367-8c06-1db16a9abf05 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:03.465914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5687005-ed9d-4367-8c06-1db16a9abf05 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:03.475862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:03.500624 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05977-98fe-45d8-94fc-b2589b03d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:03.501276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05977-98fe-45d8-94fc-b2589b03d039 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:03.501556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05977-98fe-45d8-94fc-b2589b03d039 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:03.501834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf05977-98fe-45d8-94fc-b2589b03d039 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:03.502561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05977-98fe-45d8-94fc-b2589b03d039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:03.502871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05977-98fe-45d8-94fc-b2589b03d039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:03.504282 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf05977-98fe-45d8-94fc-b2589b03d039 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:03.516566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 621/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:03.522385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35763-78cb-415d-a82d-8c5221010693 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:03.623638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35763-78cb-415d-a82d-8c5221010693 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:03.657628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db7ef7-001c-49cf-afc2-1d923aaabd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:03.658431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db7ef7-001c-49cf-afc2-1d923aaabd02 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:03.658715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db7ef7-001c-49cf-afc2-1d923aaabd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:03.658990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db7ef7-001c-49cf-afc2-1d923aaabd02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:03.661762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:03.666857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db7ef7-001c-49cf-afc2-1d923aaabd02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:03.668341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db7ef7-001c-49cf-afc2-1d923aaabd02 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-15db7ef7-001c-49cf-afc2-1d923aaabd02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:59:03.682846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:03.683813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:03.684952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 618/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:03.690003 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05977-98fe-45d8-94fc-b2589b03d039 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:03.793602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf05977-98fe-45d8-94fc-b2589b03d039 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:03.826598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c25579-63f0-48c7-908f-d5b33908c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:03.827252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c25579-63f0-48c7-908f-d5b33908c9fa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:03.827536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c25579-63f0-48c7-908f-d5b33908c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:03.827807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c25579-63f0-48c7-908f-d5b33908c9fa None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:03.828665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c25579-63f0-48c7-908f-d5b33908c9fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:03.828971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c25579-63f0-48c7-908f-d5b33908c9fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:03.830384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c25579-63f0-48c7-908f-d5b33908c9fa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:03.847763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 622/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Jun 28 11:59:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:03.853644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db7ef7-001c-49cf-afc2-1d923aaabd02 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:03.953966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db7ef7-001c-49cf-afc2-1d923aaabd02 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:03.986484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6d8d9-45e0-43e8-a5c3-7726d040a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:03.987134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6d8d9-45e0-43e8-a5c3-7726d040a763 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:03.987409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6d8d9-45e0-43e8-a5c3-7726d040a763 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:03.987680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6d8d9-45e0-43e8-a5c3-7726d040a763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:04.047157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:04.053498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6d8d9-45e0-43e8-a5c3-7726d040a763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:04.055001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6d8d9-45e0-43e8-a5c3-7726d040a763 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:04.151248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 619/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:59:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:59:04.157105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c25579-63f0-48c7-908f-d5b33908c9fa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:04.184133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:04.256162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c25579-63f0-48c7-908f-d5b33908c9fa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:04.289215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c40f9-c7f7-4207-b41e-c559e333936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:04.289991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c40f9-c7f7-4207-b41e-c559e333936c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:04.290271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c40f9-c7f7-4207-b41e-c559e333936c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:04.290543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c40f9-c7f7-4207-b41e-c559e333936c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:04.300663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c40f9-c7f7-4207-b41e-c559e333936c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:04.302665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c40f9-c7f7-4207-b41e-c559e333936c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b54c40f9-c7f7-4207-b41e-c559e333936c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:59:04.320011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:04.321089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:04.322182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:59:04.322182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:59:04.322182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:04.322182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:04.322182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 623/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:04.327159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6d8d9-45e0-43e8-a5c3-7726d040a763 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:04.419277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:04.425668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6d8d9-45e0-43e8-a5c3-7726d040a763 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:04.459572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84919b03-c0eb-4f3b-a988-cdbcac0f5cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:04.460267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84919b03-c0eb-4f3b-a988-cdbcac0f5cbc None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:04.460548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84919b03-c0eb-4f3b-a988-cdbcac0f5cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:04.460823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84919b03-c0eb-4f3b-a988-cdbcac0f5cbc None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:04.461542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84919b03-c0eb-4f3b-a988-cdbcac0f5cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:04.461847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84919b03-c0eb-4f3b-a988-cdbcac0f5cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:04.463213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84919b03-c0eb-4f3b-a988-cdbcac0f5cbc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:04.474609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 620/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:04.480321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c40f9-c7f7-4207-b41e-c559e333936c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:04.561299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:04.581444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c40f9-c7f7-4207-b41e-c559e333936c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:04.614222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e585d2-1017-4786-ac25-4dd82f761528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:04.615010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e585d2-1017-4786-ac25-4dd82f761528 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:04.615290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e585d2-1017-4786-ac25-4dd82f761528 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:04.615565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e585d2-1017-4786-ac25-4dd82f761528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:04.621948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e585d2-1017-4786-ac25-4dd82f761528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:04.624033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e585d2-1017-4786-ac25-4dd82f761528 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-14e585d2-1017-4786-ac25-4dd82f761528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:59:04.637327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:04.638260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:04.639404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:59:04.639404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:59:04.639404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:59:04.639404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:59:04.639404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:59:04.639404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:59:04.639404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:04.639404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:04.641613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 624/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:04.646429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84919b03-c0eb-4f3b-a988-cdbcac0f5cbc None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:04.745315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84919b03-c0eb-4f3b-a988-cdbcac0f5cbc None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:04.777980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0db4e-bc96-45da-bd13-4663b9699c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:04.778576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0db4e-bc96-45da-bd13-4663b9699c8c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:04.778864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0db4e-bc96-45da-bd13-4663b9699c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:04.779682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0db4e-bc96-45da-bd13-4663b9699c8c None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:04.780580 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0db4e-bc96-45da-bd13-4663b9699c8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:04.780893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0db4e-bc96-45da-bd13-4663b9699c8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:04.782338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0db4e-bc96-45da-bd13-4663b9699c8c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:04.794496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 621/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:04.801028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e585d2-1017-4786-ac25-4dd82f761528 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:04.901214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e585d2-1017-4786-ac25-4dd82f761528 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:04.934836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf64e16-d8c9-45d1-bec7-6a1698b37cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:04.935605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf64e16-d8c9-45d1-bec7-6a1698b37cba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:04.935957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf64e16-d8c9-45d1-bec7-6a1698b37cba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:04.936192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf64e16-d8c9-45d1-bec7-6a1698b37cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:04.937022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf64e16-d8c9-45d1-bec7-6a1698b37cba None admin] RBAC: Adding query filter params (role.id=4ebdbc7b2e0b4807a0ef679e0f061a53, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=c7db581dec064fe0afeb4be5838470bf) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:04.937334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf64e16-d8c9-45d1-bec7-6a1698b37cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:04.938763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf64e16-d8c9-45d1-bec7-6a1698b37cba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:04.944429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 625/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:59:04 2022] GET /identity/v3/role_assignments?user.id=c7db581dec064fe0afeb4be5838470bf&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=4ebdbc7b2e0b4807a0ef679e0f061a53 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:07.036062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c2127-0fbb-4f72-9eb7-db970d06c1fe None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:07.036619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c2127-0fbb-4f72-9eb7-db970d06c1fe None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:07.036724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c2127-0fbb-4f72-9eb7-db970d06c1fe None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:07.038063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 622/1247] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:59:07.043090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c5e9-d4fe-4140-85b5-d859c450315b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:07.043501 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c5e9-d4fe-4140-85b5-d859c450315b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:07.043695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c5e9-d4fe-4140-85b5-d859c450315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:07.048771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:07.061433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ad64c5e9-d4fe-4140-85b5-d859c450315b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:59:07.062633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad64c5e9-d4fe-4140-85b5-d859c450315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:59:07.126847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 626/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:59:07.151530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c2127-0fbb-4f72-9eb7-db970d06c1fe None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:07.169206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:07.250611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c2127-0fbb-4f72-9eb7-db970d06c1fe None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:07.282967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff79071-4568-4dec-aeaa-837485f2f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:07.283758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff79071-4568-4dec-aeaa-837485f2f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:07.284066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff79071-4568-4dec-aeaa-837485f2f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:07.284339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff79071-4568-4dec-aeaa-837485f2f6c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:07.295607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff79071-4568-4dec-aeaa-837485f2f6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-9ff79071-4568-4dec-aeaa-837485f2f6c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:59:07.301989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:07.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:07.303908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 623/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:07.309195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c5e9-d4fe-4140-85b5-d859c450315b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:07.405879 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64c5e9-d4fe-4140-85b5-d859c450315b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:07.433905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:07.438783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05152621-7ce1-435a-90ce-3a5fbd83d065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:07.439439 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05152621-7ce1-435a-90ce-3a5fbd83d065 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:07.439721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05152621-7ce1-435a-90ce-3a5fbd83d065 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:07.440028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05152621-7ce1-435a-90ce-3a5fbd83d065 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:07.440770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05152621-7ce1-435a-90ce-3a5fbd83d065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:07.441075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05152621-7ce1-435a-90ce-3a5fbd83d065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:07.442438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05152621-7ce1-435a-90ce-3a5fbd83d065 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:07.450117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 627/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:07.456347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff79071-4568-4dec-aeaa-837485f2f6c7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:07.534738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:07.556831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff79071-4568-4dec-aeaa-837485f2f6c7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:07.589403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e63fce-e7b0-4fd6-b42f-ba7431a5484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:07.590188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e63fce-e7b0-4fd6-b42f-ba7431a5484f None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:07.590470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e63fce-e7b0-4fd6-b42f-ba7431a5484f None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:07.590792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e63fce-e7b0-4fd6-b42f-ba7431a5484f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:07.601883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e63fce-e7b0-4fd6-b42f-ba7431a5484f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:07.606885 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e63fce-e7b0-4fd6-b42f-ba7431a5484f None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-91e63fce-e7b0-4fd6-b42f-ba7431a5484f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:59:07.620369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:07.624978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:07.626120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:59:07.626120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:59:07.626120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:07.626120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:07.626120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 624/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:07.627906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05152621-7ce1-435a-90ce-3a5fbd83d065 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:07.726307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05152621-7ce1-435a-90ce-3a5fbd83d065 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:07.760221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c59cf7-1cbe-4469-a738-34a8ecff7501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:07.760908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c59cf7-1cbe-4469-a738-34a8ecff7501 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:07.761195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c59cf7-1cbe-4469-a738-34a8ecff7501 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:07.761466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c59cf7-1cbe-4469-a738-34a8ecff7501 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:07.762187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c59cf7-1cbe-4469-a738-34a8ecff7501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:07.762562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c59cf7-1cbe-4469-a738-34a8ecff7501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:07.764550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c59cf7-1cbe-4469-a738-34a8ecff7501 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:07.776204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 628/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 11:59:07.782410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e63fce-e7b0-4fd6-b42f-ba7431a5484f None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:07.880957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e63fce-e7b0-4fd6-b42f-ba7431a5484f None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:07.906539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:07.914061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3ff81-0521-4c78-9ccb-cdd68b48b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:07.914847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ff81-0521-4c78-9ccb-cdd68b48b25a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:07.915125 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ff81-0521-4c78-9ccb-cdd68b48b25a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:07.915394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ff81-0521-4c78-9ccb-cdd68b48b25a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:07.923414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3ff81-0521-4c78-9ccb-cdd68b48b25a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:07.925003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3ff81-0521-4c78-9ccb-cdd68b48b25a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-dcd3ff81-0521-4c78-9ccb-cdd68b48b25a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:59:07.947301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:07.948478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:07.949822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 625/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:07.955062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c59cf7-1cbe-4469-a738-34a8ecff7501 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:08.009271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:08.053449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c59cf7-1cbe-4469-a738-34a8ecff7501 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:08.087423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eacb5-4ed8-44b5-ba94-6d4bff8429cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:08.088117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eacb5-4ed8-44b5-ba94-6d4bff8429cf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:08.088408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eacb5-4ed8-44b5-ba94-6d4bff8429cf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:08.088752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05eacb5-4ed8-44b5-ba94-6d4bff8429cf None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:08.089602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eacb5-4ed8-44b5-ba94-6d4bff8429cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:08.089918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eacb5-4ed8-44b5-ba94-6d4bff8429cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:08.091385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05eacb5-4ed8-44b5-ba94-6d4bff8429cf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:08.109508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 629/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Jun 28 11:59:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:08.115173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3ff81-0521-4c78-9ccb-cdd68b48b25a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:08.214118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3ff81-0521-4c78-9ccb-cdd68b48b25a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:08.247434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e0140-31eb-4893-9548-b305908bde7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:08.248696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0140-31eb-4893-9548-b305908bde7a None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:08.248980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0140-31eb-4893-9548-b305908bde7a None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:08.249326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e0140-31eb-4893-9548-b305908bde7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:08.302444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:08.315200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e0140-31eb-4893-9548-b305908bde7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:08.316686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e0140-31eb-4893-9548-b305908bde7a None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:08.414007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 626/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:59:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:59:08.420504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eacb5-4ed8-44b5-ba94-6d4bff8429cf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:08.517586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05eacb5-4ed8-44b5-ba94-6d4bff8429cf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:08.532069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:08.553815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f3c91-99f4-4398-915f-94e7eff4b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:08.554615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f3c91-99f4-4398-915f-94e7eff4b1ed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:08.554900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f3c91-99f4-4398-915f-94e7eff4b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:08.555176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f3c91-99f4-4398-915f-94e7eff4b1ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:08.564920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f3c91-99f4-4398-915f-94e7eff4b1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:08.566333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f3c91-99f4-4398-915f-94e7eff4b1ed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9d6f3c91-99f4-4398-915f-94e7eff4b1ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:59:08.583128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:08.590342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:08.592015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:59:08.592015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:59:08.592015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:08.592015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:08.592015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 630/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:08.592385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e0140-31eb-4893-9548-b305908bde7a None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:08.678863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:08.690329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e0140-31eb-4893-9548-b305908bde7a None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:08.723210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d356-e247-41ed-801a-8b13b38987ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:08.723941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d356-e247-41ed-801a-8b13b38987ea None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:08.724227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d356-e247-41ed-801a-8b13b38987ea None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:08.724503 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5d356-e247-41ed-801a-8b13b38987ea None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:08.725226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d356-e247-41ed-801a-8b13b38987ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:08.725533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d356-e247-41ed-801a-8b13b38987ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:08.726949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5d356-e247-41ed-801a-8b13b38987ea None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:08.738560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 627/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:08.744236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f3c91-99f4-4398-915f-94e7eff4b1ed None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:08.844205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f3c91-99f4-4398-915f-94e7eff4b1ed None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:08.880242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301387-de45-481c-aa1d-0b668e15344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:08.881046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301387-de45-481c-aa1d-0b668e15344e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:08.881330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301387-de45-481c-aa1d-0b668e15344e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:08.881604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301387-de45-481c-aa1d-0b668e15344e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:08.888476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0301387-de45-481c-aa1d-0b668e15344e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:08.889928 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0301387-de45-481c-aa1d-0b668e15344e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d0301387-de45-481c-aa1d-0b668e15344e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:59:08.903563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:08.904889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:08.905822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:59:08.905822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:59:08.905822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:59:08.905822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:59:08.905822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:59:08.905822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:59:08.905822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:08.905822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:08.905822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 631/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:08.910605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d356-e247-41ed-801a-8b13b38987ea None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:09.009851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5d356-e247-41ed-801a-8b13b38987ea None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:09.041626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a7141-5d92-4d72-861a-0fe49a7958fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:09.042285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7141-5d92-4d72-861a-0fe49a7958fe None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:09.044078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7141-5d92-4d72-861a-0fe49a7958fe None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:09.044880 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7141-5d92-4d72-861a-0fe49a7958fe None admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:09.045721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a7141-5d92-4d72-861a-0fe49a7958fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:09.046044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a7141-5d92-4d72-861a-0fe49a7958fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:09.047487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a7141-5d92-4d72-861a-0fe49a7958fe None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:09.059515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 628/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:09.066218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301387-de45-481c-aa1d-0b668e15344e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:09.092053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:09.168901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301387-de45-481c-aa1d-0b668e15344e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:09.202771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d5911-c6d8-4e9d-8c21-2f549fcf48f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:09.203425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5911-c6d8-4e9d-8c21-2f549fcf48f4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:09.203710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5911-c6d8-4e9d-8c21-2f549fcf48f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:09.204012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d5911-c6d8-4e9d-8c21-2f549fcf48f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:09.204841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d5911-c6d8-4e9d-8c21-2f549fcf48f4 None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=c7db581dec064fe0afeb4be5838470bf) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:09.205152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d5911-c6d8-4e9d-8c21-2f549fcf48f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:09.206570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d5911-c6d8-4e9d-8c21-2f549fcf48f4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:09.211967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 632/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:59:09 2022] GET /identity/v3/role_assignments?user.id=c7db581dec064fe0afeb4be5838470bf&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:11.234173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fad7-a0cb-4040-8ad8-53649cf8ead4 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:11.234723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fad7-a0cb-4040-8ad8-53649cf8ead4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:11.234723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8fad7-a0cb-4040-8ad8-53649cf8ead4 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:11.236202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 629/1261] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:59:11.241329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d834eb-181f-4def-a9fa-8288c2852e3c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:11.241722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d834eb-181f-4def-a9fa-8288c2852e3c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:11.241892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d834eb-181f-4def-a9fa-8288c2852e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:11.258932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f3d834eb-181f-4def-a9fa-8288c2852e3c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:59:11.260159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f3d834eb-181f-4def-a9fa-8288c2852e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:59:11.327415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 633/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:59:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:59:11.350453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8fad7-a0cb-4040-8ad8-53649cf8ead4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:11.361882 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:11.452001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8fad7-a0cb-4040-8ad8-53649cf8ead4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:11.487953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1a94e-3c23-47e2-92e1-285bf930db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:11.488705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1a94e-3c23-47e2-92e1-285bf930db3e None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:11.488987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1a94e-3c23-47e2-92e1-285bf930db3e None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:11.489263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1a94e-3c23-47e2-92e1-285bf930db3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:11.499801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1a94e-3c23-47e2-92e1-285bf930db3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-0ee1a94e-3c23-47e2-92e1-285bf930db3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:59:11.507543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:11.508724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:11.509739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 630/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:11.514965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d834eb-181f-4def-a9fa-8288c2852e3c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:11.534021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:11.613131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d834eb-181f-4def-a9fa-8288c2852e3c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:11.646254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abe874-7fe5-4db4-b031-5e880ebd1a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:11.646916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abe874-7fe5-4db4-b031-5e880ebd1a76 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:11.647199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abe874-7fe5-4db4-b031-5e880ebd1a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:11.647478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abe874-7fe5-4db4-b031-5e880ebd1a76 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:11.648264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abe874-7fe5-4db4-b031-5e880ebd1a76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:11.648574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abe874-7fe5-4db4-b031-5e880ebd1a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:11.649946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abe874-7fe5-4db4-b031-5e880ebd1a76 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:11.658432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 634/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:11.664582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1a94e-3c23-47e2-92e1-285bf930db3e None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:11.729310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:11.761702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1a94e-3c23-47e2-92e1-285bf930db3e None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:11.796948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed08b2-5489-4aec-b5dd-f2e4d52ea1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:11.797783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed08b2-5489-4aec-b5dd-f2e4d52ea1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:11.798062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed08b2-5489-4aec-b5dd-f2e4d52ea1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:11.798336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed08b2-5489-4aec-b5dd-f2e4d52ea1f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:11.808622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed08b2-5489-4aec-b5dd-f2e4d52ea1f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:11.810106 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed08b2-5489-4aec-b5dd-f2e4d52ea1f8 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-08ed08b2-5489-4aec-b5dd-f2e4d52ea1f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:59:11.827121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:11.828234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:11.829383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:59:11.829383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:59:11.829383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:11.829383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:11.829383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 631/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:11.834083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abe874-7fe5-4db4-b031-5e880ebd1a76 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:11.916453 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:11.935883 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abe874-7fe5-4db4-b031-5e880ebd1a76 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:11.967522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cd6bd-27e1-4385-9dd3-dd6a788e8253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:11.968214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd6bd-27e1-4385-9dd3-dd6a788e8253 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:11.968502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd6bd-27e1-4385-9dd3-dd6a788e8253 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:11.969029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd6bd-27e1-4385-9dd3-dd6a788e8253 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:11.969753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cd6bd-27e1-4385-9dd3-dd6a788e8253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:11.970062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cd6bd-27e1-4385-9dd3-dd6a788e8253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:11.971433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cd6bd-27e1-4385-9dd3-dd6a788e8253 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:11.982581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 635/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:11.988529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed08b2-5489-4aec-b5dd-f2e4d52ea1f8 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:12.087915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed08b2-5489-4aec-b5dd-f2e4d52ea1f8 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:12.108402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:12.122129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737de14-753d-43b7-94be-2bf747c54a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:12.123594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737de14-753d-43b7-94be-2bf747c54a2c None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:12.123899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737de14-753d-43b7-94be-2bf747c54a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:12.124173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737de14-753d-43b7-94be-2bf747c54a2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:12.131487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737de14-753d-43b7-94be-2bf747c54a2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:12.132964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737de14-753d-43b7-94be-2bf747c54a2c None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-a737de14-753d-43b7-94be-2bf747c54a2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:59:12.147758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:12.148811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:12.150306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 632/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:12.155056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cd6bd-27e1-4385-9dd3-dd6a788e8253 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:12.254252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cd6bd-27e1-4385-9dd3-dd6a788e8253 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:12.287702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c254e-1c92-4f18-bf9a-ad5ceab03b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:12.288394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c254e-1c92-4f18-bf9a-ad5ceab03b8a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:12.288750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c254e-1c92-4f18-bf9a-ad5ceab03b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:12.289034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c254e-1c92-4f18-bf9a-ad5ceab03b8a None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:12.289869 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c254e-1c92-4f18-bf9a-ad5ceab03b8a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:12.290182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c254e-1c92-4f18-bf9a-ad5ceab03b8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:12.291618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c254e-1c92-4f18-bf9a-ad5ceab03b8a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:12.301421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:12.309252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 636/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Jun 28 11:59:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:12.315468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737de14-753d-43b7-94be-2bf747c54a2c None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:12.415489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737de14-753d-43b7-94be-2bf747c54a2c None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:12.448311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377188-f28c-4eff-a9c1-523d7379d9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:12.449131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377188-f28c-4eff-a9c1-523d7379d9fb None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:12.449391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377188-f28c-4eff-a9c1-523d7379d9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:12.449668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377188-f28c-4eff-a9c1-523d7379d9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:12.463463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377188-f28c-4eff-a9c1-523d7379d9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:12.468070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377188-f28c-4eff-a9c1-523d7379d9fb None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-c8377188-f28c-4eff-a9c1-523d7379d9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:59:12.482488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:12.483545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:12.484529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:59:12.484529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:59:12.484529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:12.484529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:12.484529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 633/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:12.489424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c254e-1c92-4f18-bf9a-ad5ceab03b8a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:12.591695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c254e-1c92-4f18-bf9a-ad5ceab03b8a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:12.626819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8276a-455c-4729-a8b6-4b6d232602dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:12.627467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8276a-455c-4729-a8b6-4b6d232602dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:12.627749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8276a-455c-4729-a8b6-4b6d232602dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:12.628051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8276a-455c-4729-a8b6-4b6d232602dc None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:12.628770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8276a-455c-4729-a8b6-4b6d232602dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:12.634593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8276a-455c-4729-a8b6-4b6d232602dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:12.634593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8276a-455c-4729-a8b6-4b6d232602dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:12.641210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 637/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:12.646925 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377188-f28c-4eff-a9c1-523d7379d9fb None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:12.678376 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:12.745093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377188-f28c-4eff-a9c1-523d7379d9fb None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:12.777409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317df906-f81d-489d-9fcc-41a18a077a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:12.778189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317df906-f81d-489d-9fcc-41a18a077a06 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:12.778471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317df906-f81d-489d-9fcc-41a18a077a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:12.778740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317df906-f81d-489d-9fcc-41a18a077a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:12.785137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317df906-f81d-489d-9fcc-41a18a077a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:12.786562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317df906-f81d-489d-9fcc-41a18a077a06 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-317df906-f81d-489d-9fcc-41a18a077a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:59:12.801619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:12.805020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:12.806821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:59:12.806821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:59:12.806821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:59:12.806821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:59:12.806821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:59:12.806821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:59:12.806821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:12.806821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:12.806821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 634/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:12.811305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8276a-455c-4729-a8b6-4b6d232602dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:12.870935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:12.911591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8276a-455c-4729-a8b6-4b6d232602dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:12.944687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa97e0-de5d-44a4-b360-351cda970d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:12.945395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa97e0-de5d-44a4-b360-351cda970d74 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:12.945587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa97e0-de5d-44a4-b360-351cda970d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:12.945862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa97e0-de5d-44a4-b360-351cda970d74 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:12.946640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa97e0-de5d-44a4-b360-351cda970d74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:12.946946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa97e0-de5d-44a4-b360-351cda970d74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:12.948401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa97e0-de5d-44a4-b360-351cda970d74 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:12.961321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 638/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:12.968045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317df906-f81d-489d-9fcc-41a18a077a06 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:13.056933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:13.065795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317df906-f81d-489d-9fcc-41a18a077a06 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:13.099143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924efe-54bc-43ce-bb12-f0a2325f8995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:13.100095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924efe-54bc-43ce-bb12-f0a2325f8995 None admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:13.100374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924efe-54bc-43ce-bb12-f0a2325f8995 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:13.100644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924efe-54bc-43ce-bb12-f0a2325f8995 None admin] PATH_INFO: `/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/c7db581dec064fe0afeb4be5838470bf/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:13.102571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924efe-54bc-43ce-bb12-f0a2325f8995 None admin] RBAC: Authorizing `identity:create_grant(project_id=e94ab17538894fe6bdae6933e33526fc, user_id=c7db581dec064fe0afeb4be5838470bf, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:13.104035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924efe-54bc-43ce-bb12-f0a2325f8995 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:13.214843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 635/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Tue Jun 28 11:59:12 2022] PUT /identity/v3/projects/e94ab17538894fe6bdae6933e33526fc/users/c7db581dec064fe0afeb4be5838470bf/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 11:59:15.256604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fa33e-74c1-4b49-8d72-c5b9a97304f0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:15.257140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fa33e-74c1-4b49-8d72-c5b9a97304f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:15.257140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fa33e-74c1-4b49-8d72-c5b9a97304f0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:15.258574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 639/1274] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:59:15.264073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ece72-beae-43f8-b6a5-413808f26f30 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:15.264470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ece72-beae-43f8-b6a5-413808f26f30 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:15.264657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ece72-beae-43f8-b6a5-413808f26f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:15.281174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c77ece72-beae-43f8-b6a5-413808f26f30 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:59:15.282348 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c77ece72-beae-43f8-b6a5-413808f26f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:59:15.348345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 636/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:59:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:59:15.372675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fa33e-74c1-4b49-8d72-c5b9a97304f0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:15.473752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fa33e-74c1-4b49-8d72-c5b9a97304f0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:15.491289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:15.508783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e243f-99e7-4616-bdbb-acfd1c5079fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:15.509512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e243f-99e7-4616-bdbb-acfd1c5079fd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:15.509796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e243f-99e7-4616-bdbb-acfd1c5079fd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:15.510069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e243f-99e7-4616-bdbb-acfd1c5079fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:15.520965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e243f-99e7-4616-bdbb-acfd1c5079fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6e0e243f-99e7-4616-bdbb-acfd1c5079fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 11:59:15.528642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:15.540884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:15.541905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 640/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Tue Jun 28 11:59:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:15.542737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ece72-beae-43f8-b6a5-413808f26f30 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:15.615227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:15.633104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ece72-beae-43f8-b6a5-413808f26f30 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:15.665607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee584481-7150-4e8f-91a8-860b965077b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:15.666267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee584481-7150-4e8f-91a8-860b965077b4 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:15.666548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee584481-7150-4e8f-91a8-860b965077b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:15.666820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee584481-7150-4e8f-91a8-860b965077b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:15.667591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee584481-7150-4e8f-91a8-860b965077b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:15.667923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee584481-7150-4e8f-91a8-860b965077b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:15.669889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee584481-7150-4e8f-91a8-860b965077b4 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:15.677820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 637/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Tue Jun 28 11:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:15.683582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e243f-99e7-4616-bdbb-acfd1c5079fd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:15.782580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e243f-99e7-4616-bdbb-acfd1c5079fd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:15.815742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fa29-b2e6-4a2b-8cca-5c4acef98658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:15.816545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fa29-b2e6-4a2b-8cca-5c4acef98658 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:15.816828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fa29-b2e6-4a2b-8cca-5c4acef98658 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:15.817103 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fa29-b2e6-4a2b-8cca-5c4acef98658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:15.827449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137fa29-b2e6-4a2b-8cca-5c4acef98658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:15.828933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137fa29-b2e6-4a2b-8cca-5c4acef98658 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8137fa29-b2e6-4a2b-8cca-5c4acef98658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:59:15.845579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:15.846649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:15.847934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:59:15.847934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:59:15.847934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:15.847934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:15.847934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 641/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:15.852410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee584481-7150-4e8f-91a8-860b965077b4 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:15.953541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee584481-7150-4e8f-91a8-860b965077b4 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:15.989527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595dc07-4f5d-4250-b32a-b7a8aae1cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:15.990236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595dc07-4f5d-4250-b32a-b7a8aae1cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:15.990516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595dc07-4f5d-4250-b32a-b7a8aae1cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:15.990787 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595dc07-4f5d-4250-b32a-b7a8aae1cfc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:15.991547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595dc07-4f5d-4250-b32a-b7a8aae1cfc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:15.991865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595dc07-4f5d-4250-b32a-b7a8aae1cfc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:15.993240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595dc07-4f5d-4250-b32a-b7a8aae1cfc2 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:16.004719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 638/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:16.010450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fa29-b2e6-4a2b-8cca-5c4acef98658 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:16.040904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:16.110537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fa29-b2e6-4a2b-8cca-5c4acef98658 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:16.143887 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb05b6-1aed-44d9-999f-ff1a96aa0e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:16.144691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb05b6-1aed-44d9-999f-ff1a96aa0e0b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:16.144976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb05b6-1aed-44d9-999f-ff1a96aa0e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:16.145249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb05b6-1aed-44d9-999f-ff1a96aa0e0b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:16.152183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb05b6-1aed-44d9-999f-ff1a96aa0e0b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:16.154145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb05b6-1aed-44d9-999f-ff1a96aa0e0b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1eeb05b6-1aed-44d9-999f-ff1a96aa0e0b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 11:59:16.168570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:16.170258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:16.171428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 642/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:16.176185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595dc07-4f5d-4250-b32a-b7a8aae1cfc2 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:16.180090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:16.273948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595dc07-4f5d-4250-b32a-b7a8aae1cfc2 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:16.306968 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297850e1-ce8b-41a4-9963-99dc4c26efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:16.307574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297850e1-ce8b-41a4-9963-99dc4c26efd7 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:16.307859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297850e1-ce8b-41a4-9963-99dc4c26efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:16.308168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297850e1-ce8b-41a4-9963-99dc4c26efd7 None admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:16.309024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297850e1-ce8b-41a4-9963-99dc4c26efd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:16.309335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297850e1-ce8b-41a4-9963-99dc4c26efd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:16.310991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297850e1-ce8b-41a4-9963-99dc4c26efd7 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:16.329363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 639/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Tue Jun 28 11:59:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:16.335015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb05b6-1aed-44d9-999f-ff1a96aa0e0b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:16.425369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:16.435097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb05b6-1aed-44d9-999f-ff1a96aa0e0b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:16.469864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6394-998f-4504-95b4-2bf9caef833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:16.470575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6394-998f-4504-95b4-2bf9caef833c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:16.470864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6394-998f-4504-95b4-2bf9caef833c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:16.471142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6394-998f-4504-95b4-2bf9caef833c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:16.541142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e6394-998f-4504-95b4-2bf9caef833c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:16.542600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e6394-998f-4504-95b4-2bf9caef833c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:16.633193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:16.644414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 643/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Tue Jun 28 11:59:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 11:59:16.650147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297850e1-ce8b-41a4-9963-99dc4c26efd7 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:16.709742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:16.746227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297850e1-ce8b-41a4-9963-99dc4c26efd7 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:16.780526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3861-17b5-49b4-929a-b29adc3df532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:16.781301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3861-17b5-49b4-929a-b29adc3df532 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:16.781583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3861-17b5-49b4-929a-b29adc3df532 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:16.781856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c3861-17b5-49b4-929a-b29adc3df532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:16.791600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c3861-17b5-49b4-929a-b29adc3df532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:16.793071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c3861-17b5-49b4-929a-b29adc3df532 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-4a9c3861-17b5-49b4-929a-b29adc3df532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 11:59:16.811567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:16.812666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:16.813751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 11:59:16.813751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 11:59:16.813751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 11:59:16.813751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:16.813751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 640/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 11:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:16.818539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6394-998f-4504-95b4-2bf9caef833c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:16.916035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6394-998f-4504-95b4-2bf9caef833c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:16.949004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12f91e-1c6d-4ce6-82e5-b87f532df6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:16.949657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f91e-1c6d-4ce6-82e5-b87f532df6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:16.949961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f91e-1c6d-4ce6-82e5-b87f532df6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:16.951055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12f91e-1c6d-4ce6-82e5-b87f532df6c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:16.951864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12f91e-1c6d-4ce6-82e5-b87f532df6c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:16.952196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12f91e-1c6d-4ce6-82e5-b87f532df6c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:16.953575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12f91e-1c6d-4ce6-82e5-b87f532df6c4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:16.964552 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 644/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Tue Jun 28 11:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:16.970922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3861-17b5-49b4-929a-b29adc3df532 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:17.071565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c3861-17b5-49b4-929a-b29adc3df532 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:17.085455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:17.104786 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f937a0-4707-4e58-a6ce-ce0826575227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:17.105569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f937a0-4707-4e58-a6ce-ce0826575227 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:17.105854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f937a0-4707-4e58-a6ce-ce0826575227 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:17.106238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f937a0-4707-4e58-a6ce-ce0826575227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:17.113292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f937a0-4707-4e58-a6ce-ce0826575227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:17.114733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f937a0-4707-4e58-a6ce-ce0826575227 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application [None req-d9f937a0-4707-4e58-a6ce-ce0826575227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 11:59:17.129837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:17.135087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:17.136413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 11:59:17.136413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 11:59:17.136413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 11:59:17.136413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 11:59:17.136413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 11:59:17.136413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 11:59:17.136413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 11:59:17.136413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: ERROR keystone.server.flask.application Jun 28 11:59:17.136413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 641/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Tue Jun 28 11:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:17.138289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12f91e-1c6d-4ce6-82e5-b87f532df6c4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:17.189666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:17.238908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12f91e-1c6d-4ce6-82e5-b87f532df6c4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:17.272276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb3a8d-061c-4311-8b80-f4046f567292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:17.272929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3a8d-061c-4311-8b80-f4046f567292 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:17.273217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3a8d-061c-4311-8b80-f4046f567292 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:17.273494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb3a8d-061c-4311-8b80-f4046f567292 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:17.274290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3a8d-061c-4311-8b80-f4046f567292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:17.274601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3a8d-061c-4311-8b80-f4046f567292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:17.276072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb3a8d-061c-4311-8b80-f4046f567292 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:17.288560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 645/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Tue Jun 28 11:59:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:17.295312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f937a0-4707-4e58-a6ce-ce0826575227 None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:17.393885 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f937a0-4707-4e58-a6ce-ce0826575227 None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:17.427462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf002c-e1b3-410c-80ca-a79c248c600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:17.428135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf002c-e1b3-410c-80ca-a79c248c600d None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:17.428420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf002c-e1b3-410c-80ca-a79c248c600d None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:17.428697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf002c-e1b3-410c-80ca-a79c248c600d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:17.429523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf002c-e1b3-410c-80ca-a79c248c600d None admin] RBAC: Adding query filter params (role.id=741fb0bc51f64821b256dbcbb7c9413c, scope.project.id=e94ab17538894fe6bdae6933e33526fc, user.id=c7db581dec064fe0afeb4be5838470bf) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:17.429836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf002c-e1b3-410c-80ca-a79c248c600d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:17.431272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf002c-e1b3-410c-80ca-a79c248c600d None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:17.437069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 642/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Tue Jun 28 11:59:17 2022] GET /identity/v3/role_assignments?user.id=c7db581dec064fe0afeb4be5838470bf&scope.project.id=e94ab17538894fe6bdae6933e33526fc&role.id=741fb0bc51f64821b256dbcbb7c9413c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:19.551305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528349-54b9-40aa-b09d-4968b2599fd0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:19.551737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528349-54b9-40aa-b09d-4968b2599fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:19.551909 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85528349-54b9-40aa-b09d-4968b2599fd0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:19.553283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 646/1288] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:59:19.558829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827eb5e3-00ad-4053-8e0a-c0a81cbd6d3b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:19.559261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827eb5e3-00ad-4053-8e0a-c0a81cbd6d3b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:19.559386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827eb5e3-00ad-4053-8e0a-c0a81cbd6d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:19.577618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-827eb5e3-00ad-4053-8e0a-c0a81cbd6d3b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:59:19.578805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-827eb5e3-00ad-4053-8e0a-c0a81cbd6d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:59:19.608650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:19.644529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 643/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:59:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:59:19.667321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528349-54b9-40aa-b09d-4968b2599fd0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:19.766902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85528349-54b9-40aa-b09d-4968b2599fd0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:19.782024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:19.805236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf1b59-dbef-4e34-aff7-cbcf3142076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:19.809266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf1b59-dbef-4e34-aff7-cbcf3142076b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:19.809266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf1b59-dbef-4e34-aff7-cbcf3142076b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:19.809266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf1b59-dbef-4e34-aff7-cbcf3142076b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:19.809266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf1b59-dbef-4e34-aff7-cbcf3142076b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:19.809266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf1b59-dbef-4e34-aff7-cbcf3142076b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-90cf1b59-dbef-4e34-aff7-cbcf3142076b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:19.820357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:19.821581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:19.822772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 647/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:59:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:19.827441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827eb5e3-00ad-4053-8e0a-c0a81cbd6d3b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:19.923817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827eb5e3-00ad-4053-8e0a-c0a81cbd6d3b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:19.956583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e87968-621c-4200-8161-708ec0771448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:19.957231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87968-621c-4200-8161-708ec0771448 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:19.957512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87968-621c-4200-8161-708ec0771448 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:19.957782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87968-621c-4200-8161-708ec0771448 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:19.958475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e87968-621c-4200-8161-708ec0771448 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:19.958773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e87968-621c-4200-8161-708ec0771448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:19.960158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e87968-621c-4200-8161-708ec0771448 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:19.964852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 644/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Jun 28 11:59:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:19.971388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf1b59-dbef-4e34-aff7-cbcf3142076b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:20.069897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf1b59-dbef-4e34-aff7-cbcf3142076b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:20.107655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad51d7-3770-4a8c-a8a0-fdd717598410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:20.108348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad51d7-3770-4a8c-a8a0-fdd717598410 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:20.108636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad51d7-3770-4a8c-a8a0-fdd717598410 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:20.108915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad51d7-3770-4a8c-a8a0-fdd717598410 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:20.109619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad51d7-3770-4a8c-a8a0-fdd717598410 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:20.109929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad51d7-3770-4a8c-a8a0-fdd717598410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:20.111321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad51d7-3770-4a8c-a8a0-fdd717598410 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:20.115769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 648/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Jun 28 11:59:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:22.131893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d3e24-900b-45e4-9783-b66f73732db2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:22.132467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d3e24-900b-45e4-9783-b66f73732db2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:22.132572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d3e24-900b-45e4-9783-b66f73732db2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:22.133876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 645/1293] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:59:22.138941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c5221-c1b1-4bc0-96e6-cb9823f06b63 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:22.139356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c5221-c1b1-4bc0-96e6-cb9823f06b63 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:22.139501 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c5221-c1b1-4bc0-96e6-cb9823f06b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:22.156894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e81c5221-c1b1-4bc0-96e6-cb9823f06b63 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:59:22.158135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e81c5221-c1b1-4bc0-96e6-cb9823f06b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:59:22.187683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:22.224492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 649/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:59:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:59:22.247559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d3e24-900b-45e4-9783-b66f73732db2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:22.277943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:22.345695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d3e24-900b-45e4-9783-b66f73732db2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:22.378997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b75e9-3d3b-44f1-852d-0939ab6c02bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:22.379652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b75e9-3d3b-44f1-852d-0939ab6c02bc None admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:22.379965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b75e9-3d3b-44f1-852d-0939ab6c02bc None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:22.380242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b75e9-3d3b-44f1-852d-0939ab6c02bc None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:22.380956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b75e9-3d3b-44f1-852d-0939ab6c02bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:22.382374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b75e9-3d3b-44f1-852d-0939ab6c02bc None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:22.438447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 646/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Tue Jun 28 11:59:22 2022] POST /identity/v3/services => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 11:59:24.488134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66f872-692f-4eff-b180-6aacaed61160 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:24.488663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66f872-692f-4eff-b180-6aacaed61160 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:24.488663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66f872-692f-4eff-b180-6aacaed61160 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:24.490049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 650/1296] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:59:24.495066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6805aa2-e27c-4633-a0a6-2a6b1fa156b0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:24.495492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6805aa2-e27c-4633-a0a6-2a6b1fa156b0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:24.495607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6805aa2-e27c-4633-a0a6-2a6b1fa156b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:24.513436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c6805aa2-e27c-4633-a0a6-2a6b1fa156b0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:59:24.514607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c6805aa2-e27c-4633-a0a6-2a6b1fa156b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:59:24.585504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 647/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:59:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:59:24.609084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66f872-692f-4eff-b180-6aacaed61160 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:24.708013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66f872-692f-4eff-b180-6aacaed61160 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:24.741373 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43aa7-d766-4879-8eb5-fef47129fa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:24.742098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43aa7-d766-4879-8eb5-fef47129fa95 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:24.742378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43aa7-d766-4879-8eb5-fef47129fa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:24.742653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43aa7-d766-4879-8eb5-fef47129fa95 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:24.743295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d43aa7-d766-4879-8eb5-fef47129fa95 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:24.744675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d43aa7-d766-4879-8eb5-fef47129fa95 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-56d43aa7-d766-4879-8eb5-fef47129fa95 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:24.757086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:24.758343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:24.759394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 651/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:59:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:24.764415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6805aa2-e27c-4633-a0a6-2a6b1fa156b0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:24.782596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:24.861885 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6805aa2-e27c-4633-a0a6-2a6b1fa156b0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:24.894633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dcff0-5241-455b-a189-9dea9eefdc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:24.895292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dcff0-5241-455b-a189-9dea9eefdc6b None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:24.895575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dcff0-5241-455b-a189-9dea9eefdc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:24.895849 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dcff0-5241-455b-a189-9dea9eefdc6b None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:24.896586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dcff0-5241-455b-a189-9dea9eefdc6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:24.896895 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dcff0-5241-455b-a189-9dea9eefdc6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:24.898300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dcff0-5241-455b-a189-9dea9eefdc6b None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:24.904126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 648/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Jun 28 11:59:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:24.910251 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43aa7-d766-4879-8eb5-fef47129fa95 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:24.941437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:25.008318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43aa7-d766-4879-8eb5-fef47129fa95 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:25.041810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eae0e-91f9-483a-8499-c30294b0ba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:25.042481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eae0e-91f9-483a-8499-c30294b0ba61 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:25.042753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eae0e-91f9-483a-8499-c30294b0ba61 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:25.043027 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eae0e-91f9-483a-8499-c30294b0ba61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:25.044421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eae0e-91f9-483a-8499-c30294b0ba61 None admin] RBAC: Adding query filter params (interface=public, service_id=d64bce31d5804b6d8d7ed4e5b35daba3, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:25.044720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eae0e-91f9-483a-8499-c30294b0ba61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:25.046084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eae0e-91f9-483a-8499-c30294b0ba61 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:25.051075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 652/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Tue Jun 28 11:59:24 2022] GET /identity/v3/endpoints?service_id=d64bce31d5804b6d8d7ed4e5b35daba3&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:25.056758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dcff0-5241-455b-a189-9dea9eefdc6b None admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:25.137039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:25.155670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dcff0-5241-455b-a189-9dea9eefdc6b None admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:25.188505 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4e55c-fc6f-4367-a892-970ff3eb13e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:25.189167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4e55c-fc6f-4367-a892-970ff3eb13e9 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:25.189451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4e55c-fc6f-4367-a892-970ff3eb13e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:25.189726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4e55c-fc6f-4367-a892-970ff3eb13e9 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:25.190407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4e55c-fc6f-4367-a892-970ff3eb13e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:25.191790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4e55c-fc6f-4367-a892-970ff3eb13e9 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:25.198551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 649/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Tue Jun 28 11:59:25 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 11:59:27.269568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fa485-7975-49bd-a6f8-bf3b744a798a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:27.270126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fa485-7975-49bd-a6f8-bf3b744a798a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:27.270126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fa485-7975-49bd-a6f8-bf3b744a798a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:27.271470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 653/1302] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 11:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 11:59:27.276560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a0b6-1e86-4df2-a065-1187ae387aac None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:27.276963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a0b6-1e86-4df2-a065-1187ae387aac None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:27.277161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6a0b6-1e86-4df2-a065-1187ae387aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:27.294574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-dce6a0b6-1e86-4df2-a065-1187ae387aac None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 11:59:27.295758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-dce6a0b6-1e86-4df2-a065-1187ae387aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 11:59:27.361579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 650/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 11:59:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 11:59:27.384616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fa485-7975-49bd-a6f8-bf3b744a798a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:27.478673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:27.485743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fa485-7975-49bd-a6f8-bf3b744a798a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:27.519281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb23025-9ee9-45fb-bc42-1fcd7dc93bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:27.520164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb23025-9ee9-45fb-bc42-1fcd7dc93bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:27.520521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb23025-9ee9-45fb-bc42-1fcd7dc93bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:27.520800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb23025-9ee9-45fb-bc42-1fcd7dc93bb5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:27.521448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb23025-9ee9-45fb-bc42-1fcd7dc93bb5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:27.522825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb23025-9ee9-45fb-bc42-1fcd7dc93bb5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-aeb23025-9ee9-45fb-bc42-1fcd7dc93bb5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 11:59:27.536004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 11:59:27.537171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 28 11:59:27.538290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 654/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Tue Jun 28 11:59:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 11:59:27.543174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a0b6-1e86-4df2-a065-1187ae387aac None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:27.618687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:27.640902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6a0b6-1e86-4df2-a065-1187ae387aac None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:27.673479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eb97c-7e19-40cd-81c5-6c44a665ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:27.674132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eb97c-7e19-40cd-81c5-6c44a665ce43 None admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:27.674412 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eb97c-7e19-40cd-81c5-6c44a665ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:27.674689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eb97c-7e19-40cd-81c5-6c44a665ce43 None admin] PATH_INFO: `/v3/services` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:27.675383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eb97c-7e19-40cd-81c5-6c44a665ce43 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 11:59:27.675687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eb97c-7e19-40cd-81c5-6c44a665ce43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:27.677153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eb97c-7e19-40cd-81c5-6c44a665ce43 None admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:27.682279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 651/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Tue Jun 28 11:59:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 11:59:27.688136 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb23025-9ee9-45fb-bc42-1fcd7dc93bb5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 11:59:27.786957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb23025-9ee9-45fb-bc42-1fcd7dc93bb5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 11:59:27.820241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fdddd-b380-46a0-ae62-2cbd3939e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 11:59:27.820904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fdddd-b380-46a0-ae62-2cbd3939e87e None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 11:59:27.821192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fdddd-b380-46a0-ae62-2cbd3939e87e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 11:59:27.821471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fdddd-b380-46a0-ae62-2cbd3939e87e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 11:59:27.822226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fdddd-b380-46a0-ae62-2cbd3939e87e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 11:59:27.823658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fdddd-b380-46a0-ae62-2cbd3939e87e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 11:59:27.918327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 655/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Tue Jun 28 11:59:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 11:59:37.689698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=30 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 11:59:37.913750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:38.154482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35f60f-27b3-4c57-9c5c-45e2dea915b4 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:38.154961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35f60f-27b3-4c57-9c5c-45e2dea915b4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:38.155268 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35f60f-27b3-4c57-9c5c-45e2dea915b4 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:38.156782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 652/1307] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:05:38.162477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933a82-3be6-4c93-b99f-cefd9c3c6058 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:38.162873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933a82-3be6-4c93-b99f-cefd9c3c6058 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:38.163174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933a82-3be6-4c93-b99f-cefd9c3c6058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:38.276560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f0933a82-3be6-4c93-b99f-cefd9c3c6058 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:05:38.284905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f0933a82-3be6-4c93-b99f-cefd9c3c6058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:38.441709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 656/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:05:38.492087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77113a-4a32-4a04-8f27-c833d07212b9 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:38.492465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77113a-4a32-4a04-8f27-c833d07212b9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:38.492651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77113a-4a32-4a04-8f27-c833d07212b9 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:38.494179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 653/1309] 10.222.0.49 () {54 vars in 964 bytes} [Tue Jun 28 12:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:05:38.500784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae65ca-8cb6-4b81-a79c-5a4d29940e81 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:38.501151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae65ca-8cb6-4b81-a79c-5a4d29940e81 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:38.501510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae65ca-8cb6-4b81-a79c-5a4d29940e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:38.589215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-22ae65ca-8cb6-4b81-a79c-5a4d29940e81 None None] MFA Rules not processed for user `3ff61c1fbdf34fa38588e4cd2cdc5398`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:05:38.591111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-22ae65ca-8cb6-4b81-a79c-5a4d29940e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:38.613572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:38.672471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 657/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Tue Jun 28 12:05:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:05:38.681376 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77113a-4a32-4a04-8f27-c833d07212b9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:05:38.683487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1e77113a-4a32-4a04-8f27-c833d07212b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:38.797704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77113a-4a32-4a04-8f27-c833d07212b9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:05:38.875384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326e718-9fd3-4141-bdf6-23d8bf559f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:05:38.876070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e718-9fd3-4141-bdf6-23d8bf559f80 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:38.876465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e718-9fd3-4141-bdf6-23d8bf559f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:38.876752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326e718-9fd3-4141-bdf6-23d8bf559f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:38.878524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a326e718-9fd3-4141-bdf6-23d8bf559f80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:38.936968 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:38.997109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326e718-9fd3-4141-bdf6-23d8bf559f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:05:38.998781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326e718-9fd3-4141-bdf6-23d8bf559f80 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:05:39.020360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 654/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:05:41.416251 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a862e-c13b-48ae-adfd-31eb04208579 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:41.416826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a862e-c13b-48ae-adfd-31eb04208579 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:41.416826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a862e-c13b-48ae-adfd-31eb04208579 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:41.419917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 658/1312] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:05:41.424294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb921254-8647-488c-aa63-3a9d6ccedbe8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:41.424730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb921254-8647-488c-aa63-3a9d6ccedbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:41.424902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb921254-8647-488c-aa63-3a9d6ccedbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:41.508784 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-cb921254-8647-488c-aa63-3a9d6ccedbe8 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:05:41.510057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cb921254-8647-488c-aa63-3a9d6ccedbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:41.623715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 655/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:05:41.679980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948fc3a-0397-4cb9-8cdd-784887c9fceb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:41.680290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948fc3a-0397-4cb9-8cdd-784887c9fceb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:41.680475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948fc3a-0397-4cb9-8cdd-784887c9fceb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:41.682013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 659/1314] 10.222.0.49 () {54 vars in 964 bytes} [Tue Jun 28 12:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:05:41.688174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824318-c26f-48b1-88c4-f7a102f85c6a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:41.688474 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824318-c26f-48b1-88c4-f7a102f85c6a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:41.688760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824318-c26f-48b1-88c4-f7a102f85c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:41.699836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:41.769859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e6824318-c26f-48b1-88c4-f7a102f85c6a None None] MFA Rules not processed for user `3ff61c1fbdf34fa38588e4cd2cdc5398`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:05:41.771886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e6824318-c26f-48b1-88c4-f7a102f85c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:41.851641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 656/1315] 10.222.0.49 () {58 vars in 1061 bytes} [Tue Jun 28 12:05:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:05:41.861238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948fc3a-0397-4cb9-8cdd-784887c9fceb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:05:41.862754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3948fc3a-0397-4cb9-8cdd-784887c9fceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:41.970225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948fc3a-0397-4cb9-8cdd-784887c9fceb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:05:42.040421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:42.043007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b7e28-4532-48ee-85f4-431d6e8dd0de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:05:42.043643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b7e28-4532-48ee-85f4-431d6e8dd0de service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:42.043949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b7e28-4532-48ee-85f4-431d6e8dd0de service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:42.044228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b7e28-4532-48ee-85f4-431d6e8dd0de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:42.045860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b7b7e28-4532-48ee-85f4-431d6e8dd0de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:42.151598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b7e28-4532-48ee-85f4-431d6e8dd0de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:05:42.153283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b7e28-4532-48ee-85f4-431d6e8dd0de service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:05:42.170967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 660/1316] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:05:44.933560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1ce2-4e4b-4985-96d6-d0fed0db52ee None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:44.934208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1ce2-4e4b-4985-96d6-d0fed0db52ee None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:44.934208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1ce2-4e4b-4985-96d6-d0fed0db52ee None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:44.935485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 657/1317] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:05:44.941026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145c404-bcbd-4471-8148-0b92c34a4536 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:44.941426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145c404-bcbd-4471-8148-0b92c34a4536 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:44.941583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145c404-bcbd-4471-8148-0b92c34a4536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:45.007664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0145c404-bcbd-4471-8148-0b92c34a4536 None None] MFA Rules not processed for user `f20f5723be9f401d87512332d772d548`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:05:45.008895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0145c404-bcbd-4471-8148-0b92c34a4536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:45.059957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:45.104371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 661/1318] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:05:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:05:45.144669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df1ce2-4e4b-4985-96d6-d0fed0db52ee None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:05:45.146169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d4df1ce2-4e4b-4985-96d6-d0fed0db52ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:45.246901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df1ce2-4e4b-4985-96d6-d0fed0db52ee None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:05:45.249595 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:45.317987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191fae7-119a-4b46-8903-461c667b1c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:05:45.318627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191fae7-119a-4b46-8903-461c667b1c62 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:45.318972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191fae7-119a-4b46-8903-461c667b1c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:45.319245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191fae7-119a-4b46-8903-461c667b1c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:45.320963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e191fae7-119a-4b46-8903-461c667b1c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:45.425881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191fae7-119a-4b46-8903-461c667b1c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:05:45.427305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191fae7-119a-4b46-8903-461c667b1c62 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:05:45.445832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 658/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:05:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:05:48.522781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28c07-ee7a-43ac-877a-c20047305478 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:48.523311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28c07-ee7a-43ac-877a-c20047305478 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:48.523409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a28c07-ee7a-43ac-877a-c20047305478 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:48.524831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 662/1320] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:05:48.531046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d0d7a-53b6-481b-a703-5110abe690cd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:48.531439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d0d7a-53b6-481b-a703-5110abe690cd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:48.531593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d0d7a-53b6-481b-a703-5110abe690cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:48.571561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:48.598262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5b0d0d7a-53b6-481b-a703-5110abe690cd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:05:48.599462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5b0d0d7a-53b6-481b-a703-5110abe690cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:48.692639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 659/1321] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:05:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:05:48.732425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a28c07-ee7a-43ac-877a-c20047305478 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:05:48.733996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-57a28c07-ee7a-43ac-877a-c20047305478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:48.835359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a28c07-ee7a-43ac-877a-c20047305478 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:05:48.907060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e3803-4b40-4359-aa77-0dbf6d77c66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:05:48.907703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e3803-4b40-4359-aa77-0dbf6d77c66a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:48.908019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e3803-4b40-4359-aa77-0dbf6d77c66a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:48.908298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e3803-4b40-4359-aa77-0dbf6d77c66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:48.909933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-254e3803-4b40-4359-aa77-0dbf6d77c66a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:48.917144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:49.021651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e3803-4b40-4359-aa77-0dbf6d77c66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:05:49.023087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e3803-4b40-4359-aa77-0dbf6d77c66a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:05:49.040789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 663/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:05:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:05:52.307254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48585-43ae-49f9-b3a5-7c25e385d56f None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:52.307785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48585-43ae-49f9-b3a5-7c25e385d56f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:52.307785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48585-43ae-49f9-b3a5-7c25e385d56f None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:52.309801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 660/1323] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:05:52.315072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f777bb-b844-4305-b324-fe1ee98284e4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:52.315541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f777bb-b844-4305-b324-fe1ee98284e4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:52.315790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f777bb-b844-4305-b324-fe1ee98284e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:52.380948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-11f777bb-b844-4305-b324-fe1ee98284e4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:05:52.382145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11f777bb-b844-4305-b324-fe1ee98284e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:52.440063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:52.480458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 664/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:05:52.517894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48585-43ae-49f9-b3a5-7c25e385d56f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:05:52.519756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b2c48585-43ae-49f9-b3a5-7c25e385d56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:52.633446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48585-43ae-49f9-b3a5-7c25e385d56f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:05:52.647467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:52.712191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bffeb2-3875-4044-b28b-d325f25c74ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:05:52.712843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bffeb2-3875-4044-b28b-d325f25c74ba service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:52.713129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bffeb2-3875-4044-b28b-d325f25c74ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:52.713523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bffeb2-3875-4044-b28b-d325f25c74ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:52.715389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-75bffeb2-3875-4044-b28b-d325f25c74ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:52.823328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bffeb2-3875-4044-b28b-d325f25c74ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:05:52.825368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bffeb2-3875-4044-b28b-d325f25c74ba service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:05:52.844911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 661/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:05:54.944465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440923-7977-4b02-9ebd-2db7d1116b89 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:54.945001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440923-7977-4b02-9ebd-2db7d1116b89 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:54.945116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440923-7977-4b02-9ebd-2db7d1116b89 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:54.946436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 665/1326] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:05:54.951859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621352e-7447-4782-a623-fe60951af512 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:54.952298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621352e-7447-4782-a623-fe60951af512 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:54.952451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621352e-7447-4782-a623-fe60951af512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:54.999390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:55.017120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4621352e-7447-4782-a623-fe60951af512 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:05:55.018308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4621352e-7447-4782-a623-fe60951af512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:55.116705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 662/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:05:55.152891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78440923-7977-4b02-9ebd-2db7d1116b89 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:05:55.154460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-78440923-7977-4b02-9ebd-2db7d1116b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:55.264027 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78440923-7977-4b02-9ebd-2db7d1116b89 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:05:55.337621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7432045-6c35-480f-95d2-7265541ed2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:05:55.338303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7432045-6c35-480f-95d2-7265541ed2dc service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:55.338587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7432045-6c35-480f-95d2-7265541ed2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:55.338864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7432045-6c35-480f-95d2-7265541ed2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:55.341370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d7432045-6c35-480f-95d2-7265541ed2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:55.358009 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:55.456923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7432045-6c35-480f-95d2-7265541ed2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:05:55.458615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7432045-6c35-480f-95d2-7265541ed2dc service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:05:55.477936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 666/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:05:57.592667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78c80c-20f4-4a82-99b3-a01e50dddc82 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:57.593212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78c80c-20f4-4a82-99b3-a01e50dddc82 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:57.593212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78c80c-20f4-4a82-99b3-a01e50dddc82 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:57.594619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 663/1329] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:05:57.600008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7a14e-3a02-4002-a53b-9d9cf65c3fb3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:57.600430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7a14e-3a02-4002-a53b-9d9cf65c3fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:57.600568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7a14e-3a02-4002-a53b-9d9cf65c3fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:57.664917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b0c7a14e-3a02-4002-a53b-9d9cf65c3fb3 None None] MFA Rules not processed for user `f20f5723be9f401d87512332d772d548`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:05:57.666112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b0c7a14e-3a02-4002-a53b-9d9cf65c3fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:57.732699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:57.766576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 667/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:05:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:05:57.804719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78c80c-20f4-4a82-99b3-a01e50dddc82 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:05:57.807280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fe78c80c-20f4-4a82-99b3-a01e50dddc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:57.913818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78c80c-20f4-4a82-99b3-a01e50dddc82 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:05:57.936221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:05:57.992726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191aa6-c68d-4410-8b29-f54fe5540ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:05:57.993298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191aa6-c68d-4410-8b29-f54fe5540ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:05:57.993583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191aa6-c68d-4410-8b29-f54fe5540ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:05:57.993857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191aa6-c68d-4410-8b29-f54fe5540ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:05:57.996621 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d0191aa6-c68d-4410-8b29-f54fe5540ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:05:58.107960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191aa6-c68d-4410-8b29-f54fe5540ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:05:58.109414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191aa6-c68d-4410-8b29-f54fe5540ea2 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:05:58.127404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 664/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:05:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:00.616322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74797430-457a-47af-9269-a92b57e25b56 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:00.616842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74797430-457a-47af-9269-a92b57e25b56 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:00.616966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74797430-457a-47af-9269-a92b57e25b56 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:00.618243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 668/1332] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:00.623657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c8d11-b66d-42b1-9224-0fe3e6ec675b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:00.624060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c8d11-b66d-42b1-9224-0fe3e6ec675b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:00.624242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c8d11-b66d-42b1-9224-0fe3e6ec675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:00.687453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:00.690120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b20c8d11-b66d-42b1-9224-0fe3e6ec675b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:00.691374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b20c8d11-b66d-42b1-9224-0fe3e6ec675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:00.789425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 665/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:00.825560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74797430-457a-47af-9269-a92b57e25b56 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:00.827099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-74797430-457a-47af-9269-a92b57e25b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:00.928023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74797430-457a-47af-9269-a92b57e25b56 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:01.000115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9a85e-888c-4b36-a4c1-44c5f630074f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:01.000782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9a85e-888c-4b36-a4c1-44c5f630074f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:01.001192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9a85e-888c-4b36-a4c1-44c5f630074f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:01.001343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9a85e-888c-4b36-a4c1-44c5f630074f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:01.002971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-93e9a85e-888c-4b36-a4c1-44c5f630074f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:01.031123 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:01.111950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9a85e-888c-4b36-a4c1-44c5f630074f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:01.113393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9a85e-888c-4b36-a4c1-44c5f630074f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:01.132868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 669/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:03.215486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcafff-59b8-4f80-8160-177172aa06ce None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:03.216077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcafff-59b8-4f80-8160-177172aa06ce None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:03.216077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcafff-59b8-4f80-8160-177172aa06ce None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:03.217532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 666/1335] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:03.222710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718146c-6862-4183-b45d-de93d4de734f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:03.223130 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718146c-6862-4183-b45d-de93d4de734f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:03.223261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718146c-6862-4183-b45d-de93d4de734f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:03.286217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3718146c-6862-4183-b45d-de93d4de734f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:03.287426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3718146c-6862-4183-b45d-de93d4de734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:03.359564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:03.380865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 670/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:03.421077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcafff-59b8-4f80-8160-177172aa06ce None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:03.422594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-57dcafff-59b8-4f80-8160-177172aa06ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:03.529284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcafff-59b8-4f80-8160-177172aa06ce None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:03.557376 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:03.601108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a950b-977d-4dee-a6e6-dd285d12096f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:03.601746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a950b-977d-4dee-a6e6-dd285d12096f service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:03.602024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a950b-977d-4dee-a6e6-dd285d12096f service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:03.602295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a950b-977d-4dee-a6e6-dd285d12096f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:03.603928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f19a950b-977d-4dee-a6e6-dd285d12096f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:03.709873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a950b-977d-4dee-a6e6-dd285d12096f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:03.711294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a950b-977d-4dee-a6e6-dd285d12096f service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:03.729728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 667/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:06.363031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fdce8-b47a-4c88-9a27-dbe51767c604 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:06.363550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fdce8-b47a-4c88-9a27-dbe51767c604 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:06.363668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fdce8-b47a-4c88-9a27-dbe51767c604 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:06.365022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 671/1338] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:06.370843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cb406-b88e-4e47-a24a-28a64f0b6dbe None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:06.371269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cb406-b88e-4e47-a24a-28a64f0b6dbe None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:06.371414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cb406-b88e-4e47-a24a-28a64f0b6dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:06.434196 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c80cb406-b88e-4e47-a24a-28a64f0b6dbe None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:06.435383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c80cb406-b88e-4e47-a24a-28a64f0b6dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:06.443470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:06.531328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 668/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:06.566718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fdce8-b47a-4c88-9a27-dbe51767c604 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:06.568388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d1fdce8-b47a-4c88-9a27-dbe51767c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:06.672582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fdce8-b47a-4c88-9a27-dbe51767c604 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:06.743574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8608bf-4bbb-4c6d-9a44-44c1a96aebe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:06.744238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8608bf-4bbb-4c6d-9a44-44c1a96aebe7 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:06.744519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8608bf-4bbb-4c6d-9a44-44c1a96aebe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:06.745334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8608bf-4bbb-4c6d-9a44-44c1a96aebe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:06.746947 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2b8608bf-4bbb-4c6d-9a44-44c1a96aebe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:06.781072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:06.854739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8608bf-4bbb-4c6d-9a44-44c1a96aebe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:06.856319 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8608bf-4bbb-4c6d-9a44-44c1a96aebe7 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:06.874332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 672/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:11.165866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d472f2-8d55-446a-a7f7-6ae86343eef3 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:11.166994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d472f2-8d55-446a-a7f7-6ae86343eef3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:11.166994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d472f2-8d55-446a-a7f7-6ae86343eef3 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:11.168498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 669/1341] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:11.173644 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7c6b4-0ebc-4ab2-85c8-5323b7a4ee31 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:11.174108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7c6b4-0ebc-4ab2-85c8-5323b7a4ee31 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:11.174212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7c6b4-0ebc-4ab2-85c8-5323b7a4ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:11.251805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-efb7c6b4-0ebc-4ab2-85c8-5323b7a4ee31 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:11.253067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-efb7c6b4-0ebc-4ab2-85c8-5323b7a4ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:11.360340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:11.373608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 673/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:11.412079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d472f2-8d55-446a-a7f7-6ae86343eef3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:11.414351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a1d472f2-8d55-446a-a7f7-6ae86343eef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:11.518018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d472f2-8d55-446a-a7f7-6ae86343eef3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:11.523821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6f7ff-b911-4460-97f2-5759e2a6cbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:11.524502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f7ff-b911-4460-97f2-5759e2a6cbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:11.524783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f7ff-b911-4460-97f2-5759e2a6cbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:11.525058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f7ff-b911-4460-97f2-5759e2a6cbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:11.535436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6f7ff-b911-4460-97f2-5759e2a6cbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:11.536898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6f7ff-b911-4460-97f2-5759e2a6cbb3 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:11.547089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 670/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:14.537076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a892c63-0656-44b6-a1e4-544229ea6ee9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:14.539141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a892c63-0656-44b6-a1e4-544229ea6ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:14.539141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a892c63-0656-44b6-a1e4-544229ea6ee9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:14.539141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 674/1344] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:14.545283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e09475-8851-4e0f-b5cb-5889179296e4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:14.545743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e09475-8851-4e0f-b5cb-5889179296e4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:14.545840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e09475-8851-4e0f-b5cb-5889179296e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:14.577465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-31e09475-8851-4e0f-b5cb-5889179296e4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:14.578713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-31e09475-8851-4e0f-b5cb-5889179296e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:14.612664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:14.668676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 671/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:14.707794 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a892c63-0656-44b6-a1e4-544229ea6ee9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:14.719651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a892c63-0656-44b6-a1e4-544229ea6ee9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:14.723191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde84a4e-b3d4-4bb4-96fc-0feb48a88c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:14.723836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde84a4e-b3d4-4bb4-96fc-0feb48a88c47 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:14.724152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde84a4e-b3d4-4bb4-96fc-0feb48a88c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:14.724430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde84a4e-b3d4-4bb4-96fc-0feb48a88c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:14.733982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde84a4e-b3d4-4bb4-96fc-0feb48a88c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:14.735433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde84a4e-b3d4-4bb4-96fc-0feb48a88c47 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:14.746330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 675/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:19.133491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca75c8-79fd-4f84-ae2c-d282410f6e8d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:19.134023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca75c8-79fd-4f84-ae2c-d282410f6e8d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:19.134023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca75c8-79fd-4f84-ae2c-d282410f6e8d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:19.136176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 672/1347] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:19.141101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0966b4-e868-4671-a2d8-a93b978d2d13 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:19.141882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0966b4-e868-4671-a2d8-a93b978d2d13 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:19.142196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0966b4-e868-4671-a2d8-a93b978d2d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:19.160845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0c0966b4-e868-4671-a2d8-a93b978d2d13 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:19.162076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0c0966b4-e868-4671-a2d8-a93b978d2d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:19.170200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 676/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:19.209235 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca75c8-79fd-4f84-ae2c-d282410f6e8d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:19.220781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca75c8-79fd-4f84-ae2c-d282410f6e8d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:19.224455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6d952-f15b-46b1-bd7a-8265f4e05ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:19.225097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6d952-f15b-46b1-bd7a-8265f4e05ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:19.225378 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6d952-f15b-46b1-bd7a-8265f4e05ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:19.225655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6d952-f15b-46b1-bd7a-8265f4e05ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:19.235217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6d952-f15b-46b1-bd7a-8265f4e05ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:19.236484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6d952-f15b-46b1-bd7a-8265f4e05ed3 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:19.246183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 673/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:24.321003 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6826b-6611-4643-9ed4-ffef1c34e344 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:24.321515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6826b-6611-4643-9ed4-ffef1c34e344 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:24.321598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6826b-6611-4643-9ed4-ffef1c34e344 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:24.323780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 677/1350] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:24.329164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400eac6-ee11-40d2-88c8-a14de8290837 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:24.329602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400eac6-ee11-40d2-88c8-a14de8290837 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:24.329962 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400eac6-ee11-40d2-88c8-a14de8290837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:24.411288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4400eac6-ee11-40d2-88c8-a14de8290837 None None] MFA Rules not processed for user `c7db581dec064fe0afeb4be5838470bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:24.413005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4400eac6-ee11-40d2-88c8-a14de8290837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:24.495922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 674/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:06:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:28.586602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006dd71-7469-4dc5-9d2c-c1b52635593c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:28.587232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006dd71-7469-4dc5-9d2c-c1b52635593c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:28.587232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006dd71-7469-4dc5-9d2c-c1b52635593c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:28.588875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 678/1352] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:28.593855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783e47-9bc0-4886-99e6-83eaf57b0527 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:28.594303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783e47-9bc0-4886-99e6-83eaf57b0527 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:28.595484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783e47-9bc0-4886-99e6-83eaf57b0527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:28.613656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8b783e47-9bc0-4886-99e6-83eaf57b0527 None None] MFA Rules not processed for user `c7db581dec064fe0afeb4be5838470bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:28.614991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8b783e47-9bc0-4886-99e6-83eaf57b0527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:28.625415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 675/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:06:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:29.155723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=13 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:30.392007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b9543-2acb-4a61-bf1c-3023e25ec763 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:30.392691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b9543-2acb-4a61-bf1c-3023e25ec763 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:30.392691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b9543-2acb-4a61-bf1c-3023e25ec763 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:30.393966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 679/1354] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:30.398915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9b191-b154-459c-9af2-3b968a77f1ce None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:30.399319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9b191-b154-459c-9af2-3b968a77f1ce None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:30.399492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9b191-b154-459c-9af2-3b968a77f1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:30.417890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a5d9b191-b154-459c-9af2-3b968a77f1ce None None] MFA Rules not processed for user `c7db581dec064fe0afeb4be5838470bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:30.419511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a5d9b191-b154-459c-9af2-3b968a77f1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:30.428338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 676/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:33.976568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c907ee-4e68-41b3-951e-9b275abb5f01 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:33.977117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c907ee-4e68-41b3-951e-9b275abb5f01 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:33.977117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c907ee-4e68-41b3-951e-9b275abb5f01 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:33.979045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 680/1356] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:33.984666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9573b7-6620-4ffc-b8a3-5d9775808d31 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:33.985588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9573b7-6620-4ffc-b8a3-5d9775808d31 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:33.986022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9573b7-6620-4ffc-b8a3-5d9775808d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:34.005711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bb9573b7-6620-4ffc-b8a3-5d9775808d31 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:34.007132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bb9573b7-6620-4ffc-b8a3-5d9775808d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:34.017899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 677/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:34.071239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c5da6-cd6c-4e0a-b089-a955d71f453a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:34.071527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c5da6-cd6c-4e0a-b089-a955d71f453a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:34.072585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c5da6-cd6c-4e0a-b089-a955d71f453a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:34.074442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 681/1358] 10.222.0.49 () {54 vars in 961 bytes} [Tue Jun 28 12:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:34.083633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fc8e-7c68-4d96-a3e1-8e78edf33f65 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:34.084190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fc8e-7c68-4d96-a3e1-8e78edf33f65 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:34.084638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fc8e-7c68-4d96-a3e1-8e78edf33f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:34.139888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:34.149143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a6b6fc8e-7c68-4d96-a3e1-8e78edf33f65 None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:34.150985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a6b6fc8e-7c68-4d96-a3e1-8e78edf33f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:34.232769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 678/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Jun 28 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:06:34.243133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c5da6-cd6c-4e0a-b089-a955d71f453a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:34.262659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c5da6-cd6c-4e0a-b089-a955d71f453a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:34.268812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30693c4-a307-4464-bc15-d6a9a09458f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:34.269681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30693c4-a307-4464-bc15-d6a9a09458f1 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:34.270038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30693c4-a307-4464-bc15-d6a9a09458f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:34.270384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30693c4-a307-4464-bc15-d6a9a09458f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:34.280260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30693c4-a307-4464-bc15-d6a9a09458f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:34.282094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30693c4-a307-4464-bc15-d6a9a09458f1 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:34.297828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 682/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:36.561024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a5cd1-dd25-4674-a2f6-8208d700d36a None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:36.561473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a5cd1-dd25-4674-a2f6-8208d700d36a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:36.561653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a5cd1-dd25-4674-a2f6-8208d700d36a None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:36.563126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 679/1361] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:36.569410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0005-6388-462d-8693-1051500f59bc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:36.571042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0005-6388-462d-8693-1051500f59bc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:36.571581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0005-6388-462d-8693-1051500f59bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:36.591185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5fce0005-6388-462d-8693-1051500f59bc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:36.592426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5fce0005-6388-462d-8693-1051500f59bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:36.600921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 683/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:36.649249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a5cd1-dd25-4674-a2f6-8208d700d36a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:36.664423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a5cd1-dd25-4674-a2f6-8208d700d36a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:36.670828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ffe4-ca33-4f06-ab9d-46f3d04a48ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:36.671557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ffe4-ca33-4f06-ab9d-46f3d04a48ea service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:36.671937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ffe4-ca33-4f06-ab9d-46f3d04a48ea service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:36.672279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ffe4-ca33-4f06-ab9d-46f3d04a48ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:36.681952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ffe4-ca33-4f06-ab9d-46f3d04a48ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:36.683620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ffe4-ca33-4f06-ab9d-46f3d04a48ea service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:36.693891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 680/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:39.185171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864efc34-7faf-46f0-bb62-12d0dbe9107a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:39.185696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864efc34-7faf-46f0-bb62-12d0dbe9107a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:39.185817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864efc34-7faf-46f0-bb62-12d0dbe9107a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:39.187094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 684/1364] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:39.192404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320d31b-c868-4f89-a187-d008673c3d0a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:39.192827 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320d31b-c868-4f89-a187-d008673c3d0a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:39.192960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320d31b-c868-4f89-a187-d008673c3d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:39.223994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0320d31b-c868-4f89-a187-d008673c3d0a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:39.225138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0320d31b-c868-4f89-a187-d008673c3d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:39.235748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 681/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:39.282595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa86211-8e8c-476b-abbd-e5833f426d26 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:39.282957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa86211-8e8c-476b-abbd-e5833f426d26 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:39.283306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa86211-8e8c-476b-abbd-e5833f426d26 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:39.284858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 685/1366] 10.222.0.49 () {54 vars in 961 bytes} [Tue Jun 28 12:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:39.290086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79861ac7-3035-4ba7-9b46-d5465e9dfb3a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:39.291107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79861ac7-3035-4ba7-9b46-d5465e9dfb3a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:39.291542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79861ac7-3035-4ba7-9b46-d5465e9dfb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:39.310017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-79861ac7-3035-4ba7-9b46-d5465e9dfb3a None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:39.311208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-79861ac7-3035-4ba7-9b46-d5465e9dfb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:39.320885 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 682/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Jun 28 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:39.328991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa86211-8e8c-476b-abbd-e5833f426d26 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:39.344231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa86211-8e8c-476b-abbd-e5833f426d26 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:39.349878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdcf0b-884b-4a53-bf8b-8613377c103b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:39.350519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdcf0b-884b-4a53-bf8b-8613377c103b service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:39.350802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdcf0b-884b-4a53-bf8b-8613377c103b service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:39.351076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdcf0b-884b-4a53-bf8b-8613377c103b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:39.360098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdcf0b-884b-4a53-bf8b-8613377c103b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:39.361662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdcf0b-884b-4a53-bf8b-8613377c103b service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:39.371143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 686/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:41.650796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf9260-ab6e-44cf-9a58-92ebcc6a44ae None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:41.651899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf9260-ab6e-44cf-9a58-92ebcc6a44ae None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:41.652330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf9260-ab6e-44cf-9a58-92ebcc6a44ae None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:41.654114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 683/1369] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:41.660104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04b037-df8a-42b2-ad99-0c492d63de0a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:41.660740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04b037-df8a-42b2-ad99-0c492d63de0a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:41.660740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04b037-df8a-42b2-ad99-0c492d63de0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:41.678891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0a04b037-df8a-42b2-ad99-0c492d63de0a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:41.680118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0a04b037-df8a-42b2-ad99-0c492d63de0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:41.688441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 687/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:41.733732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf9260-ab6e-44cf-9a58-92ebcc6a44ae None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:41.750181 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf9260-ab6e-44cf-9a58-92ebcc6a44ae None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:41.756732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481495a-4187-4b80-a8a0-c937216e1277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:41.757518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481495a-4187-4b80-a8a0-c937216e1277 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:41.757918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481495a-4187-4b80-a8a0-c937216e1277 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:41.758297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481495a-4187-4b80-a8a0-c937216e1277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:41.768391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481495a-4187-4b80-a8a0-c937216e1277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:41.770110 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481495a-4187-4b80-a8a0-c937216e1277 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:41.781334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 684/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:42.273560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9d4d-a945-452d-a19b-7fcb755f5bc7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:42.273845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9d4d-a945-452d-a19b-7fcb755f5bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:42.274125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9d4d-a945-452d-a19b-7fcb755f5bc7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:42.279486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 688/1372] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:42.281373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997f6ef-ca5e-42e1-b478-f4a201680374 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:42.281659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997f6ef-ca5e-42e1-b478-f4a201680374 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:42.281931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997f6ef-ca5e-42e1-b478-f4a201680374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:42.302379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0997f6ef-ca5e-42e1-b478-f4a201680374 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:42.303583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0997f6ef-ca5e-42e1-b478-f4a201680374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:42.313340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 685/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:42.657836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17ff2-74ed-42b3-bc67-0cf6743676b9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:42.657836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17ff2-74ed-42b3-bc67-0cf6743676b9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:42.657836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17ff2-74ed-42b3-bc67-0cf6743676b9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:42.657836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 689/1374] 10.222.0.49 () {54 vars in 963 bytes} [Tue Jun 28 12:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:42.662789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227428b0-9eec-47f9-9fb0-0905622e442f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:42.663321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227428b0-9eec-47f9-9fb0-0905622e442f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:42.663321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227428b0-9eec-47f9-9fb0-0905622e442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:42.720174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-227428b0-9eec-47f9-9fb0-0905622e442f None None] MFA Rules not processed for user `62bbcb039ed44749ab80bfc97dabd7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:42.721562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-227428b0-9eec-47f9-9fb0-0905622e442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:42.785719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 686/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Tue Jun 28 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:42.793938 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a17ff2-74ed-42b3-bc67-0cf6743676b9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:42.805210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a17ff2-74ed-42b3-bc67-0cf6743676b9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:42.808966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca616b-90d6-4ecc-a556-83054b77fa21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:42.809708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca616b-90d6-4ecc-a556-83054b77fa21 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:42.810093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca616b-90d6-4ecc-a556-83054b77fa21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:42.810489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca616b-90d6-4ecc-a556-83054b77fa21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:42.819771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca616b-90d6-4ecc-a556-83054b77fa21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:42.821390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca616b-90d6-4ecc-a556-83054b77fa21 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:42.831583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 690/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:44.047379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f659f8-c9d7-4234-9924-596944065af6 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:44.048001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f659f8-c9d7-4234-9924-596944065af6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:44.048001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f659f8-c9d7-4234-9924-596944065af6 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:44.049347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 687/1377] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 12:06:44.054590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197e97-8be5-4629-8f0e-230e2e041618 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:44.055009 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197e97-8be5-4629-8f0e-230e2e041618 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:44.055189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04197e97-8be5-4629-8f0e-230e2e041618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:44.073510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-04197e97-8be5-4629-8f0e-230e2e041618 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:44.074724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04197e97-8be5-4629-8f0e-230e2e041618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:44.082841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 691/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:44.126650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f659f8-c9d7-4234-9924-596944065af6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:44.141680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f659f8-c9d7-4234-9924-596944065af6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:44.147040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3747e-4868-4537-965a-a1991b1c7dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:44.147677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3747e-4868-4537-965a-a1991b1c7dd9 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:44.147986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3747e-4868-4537-965a-a1991b1c7dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:44.148265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3747e-4868-4537-965a-a1991b1c7dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:44.157037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3747e-4868-4537-965a-a1991b1c7dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:44.158621 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3747e-4868-4537-965a-a1991b1c7dd9 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:44.162476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:44.169156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 688/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:46.423763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcada074-418e-481f-b001-18f261f368e9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:46.424330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcada074-418e-481f-b001-18f261f368e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:46.424330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcada074-418e-481f-b001-18f261f368e9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:46.425723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 692/1380] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:46.431573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bbed7-1c48-4269-84ff-3f44a785e1f9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:46.432013 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bbed7-1c48-4269-84ff-3f44a785e1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:46.432246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bbed7-1c48-4269-84ff-3f44a785e1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:46.456439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-454bbed7-1c48-4269-84ff-3f44a785e1f9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:46.457866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-454bbed7-1c48-4269-84ff-3f44a785e1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:46.473942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 689/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:46.530717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcada074-418e-481f-b001-18f261f368e9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:46.558720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcada074-418e-481f-b001-18f261f368e9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:46.569434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7e21a-63e6-4dc8-801d-c0d0bf4ee594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:46.570363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7e21a-63e6-4dc8-801d-c0d0bf4ee594 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:46.570918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7e21a-63e6-4dc8-801d-c0d0bf4ee594 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:46.571403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7e21a-63e6-4dc8-801d-c0d0bf4ee594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:46.583914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7e21a-63e6-4dc8-801d-c0d0bf4ee594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:46.587497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7e21a-63e6-4dc8-801d-c0d0bf4ee594 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:46.612892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 693/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:48.877062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6647f88-acb8-4a0b-9b8e-8bf939febdf0 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:48.877486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6647f88-acb8-4a0b-9b8e-8bf939febdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:48.877828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6647f88-acb8-4a0b-9b8e-8bf939febdf0 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:48.880785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 690/1383] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:48.885000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc9d6-283c-4088-b8e4-2adcd759c71a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:48.885391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc9d6-283c-4088-b8e4-2adcd759c71a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:48.885734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfc9d6-283c-4088-b8e4-2adcd759c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:48.907298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-26cfc9d6-283c-4088-b8e4-2adcd759c71a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:48.909121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-26cfc9d6-283c-4088-b8e4-2adcd759c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:48.918445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 694/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:06:48.959967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6647f88-acb8-4a0b-9b8e-8bf939febdf0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:48.974700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6647f88-acb8-4a0b-9b8e-8bf939febdf0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:48.980921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9be03-b769-4d09-9bda-b63a893b3b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:48.981549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9be03-b769-4d09-9bda-b63a893b3b9b service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:48.981827 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9be03-b769-4d09-9bda-b63a893b3b9b service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:48.982096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9be03-b769-4d09-9bda-b63a893b3b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:48.990084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9be03-b769-4d09-9bda-b63a893b3b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:48.991686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9be03-b769-4d09-9bda-b63a893b3b9b service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:49.001448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 691/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:51.156457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29911f39-8953-4ee3-9d2f-f1f49acf196f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:51.156999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29911f39-8953-4ee3-9d2f-f1f49acf196f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:51.157230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29911f39-8953-4ee3-9d2f-f1f49acf196f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:51.159008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 695/1386] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:51.165480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d05159-ac6f-46c6-92fc-0e08360a1ad0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:51.166109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d05159-ac6f-46c6-92fc-0e08360a1ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:51.166207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d05159-ac6f-46c6-92fc-0e08360a1ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:51.185343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e0d05159-ac6f-46c6-92fc-0e08360a1ad0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:51.186540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e0d05159-ac6f-46c6-92fc-0e08360a1ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:51.194576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 692/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:51.241908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29911f39-8953-4ee3-9d2f-f1f49acf196f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:51.260993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29911f39-8953-4ee3-9d2f-f1f49acf196f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:51.267984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01438b-c233-4486-8e3f-58487fbb30dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:51.268647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01438b-c233-4486-8e3f-58487fbb30dd service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:51.268936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01438b-c233-4486-8e3f-58487fbb30dd service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:51.269242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01438b-c233-4486-8e3f-58487fbb30dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:51.279446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01438b-c233-4486-8e3f-58487fbb30dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:51.281212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01438b-c233-4486-8e3f-58487fbb30dd service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:51.295079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 696/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:54.052009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa38b3-650c-4663-9423-40746dc17b10 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:54.052714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa38b3-650c-4663-9423-40746dc17b10 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:54.052714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa38b3-650c-4663-9423-40746dc17b10 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:54.053997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 693/1389] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:54.059862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ff16-e8e6-4cfe-ba57-e728582c9c4e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:54.060334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ff16-e8e6-4cfe-ba57-e728582c9c4e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:54.060695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ff16-e8e6-4cfe-ba57-e728582c9c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:54.083216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6254ff16-e8e6-4cfe-ba57-e728582c9c4e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:54.084739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6254ff16-e8e6-4cfe-ba57-e728582c9c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:54.096112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 697/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:54.142708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa38b3-650c-4663-9423-40746dc17b10 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:54.160927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa38b3-650c-4663-9423-40746dc17b10 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:54.168485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45fe66-caff-4f3b-9951-1f5aab13e1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:54.169267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45fe66-caff-4f3b-9951-1f5aab13e1c8 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:54.169886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45fe66-caff-4f3b-9951-1f5aab13e1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:54.170404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45fe66-caff-4f3b-9951-1f5aab13e1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:54.180853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45fe66-caff-4f3b-9951-1f5aab13e1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:54.182884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45fe66-caff-4f3b-9951-1f5aab13e1c8 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:54.195038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 694/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:56.463462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa93745-c48d-4e45-9259-fff45bbbd6e9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:56.464146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa93745-c48d-4e45-9259-fff45bbbd6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:56.464146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa93745-c48d-4e45-9259-fff45bbbd6e9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:56.465533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 698/1392] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:56.470815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c6c9-803f-4e8b-a660-626300b8df4f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:56.471259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c6c9-803f-4e8b-a660-626300b8df4f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:56.471376 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c6c9-803f-4e8b-a660-626300b8df4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:56.489385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ef51c6c9-803f-4e8b-a660-626300b8df4f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:56.490577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ef51c6c9-803f-4e8b-a660-626300b8df4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:56.499566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 695/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:56.544313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa93745-c48d-4e45-9259-fff45bbbd6e9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:56.559732 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa93745-c48d-4e45-9259-fff45bbbd6e9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:56.565252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf2b17-c296-4651-9a33-b082a798dcbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:56.565895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf2b17-c296-4651-9a33-b082a798dcbe service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:56.566218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf2b17-c296-4651-9a33-b082a798dcbe service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:56.566611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf2b17-c296-4651-9a33-b082a798dcbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:56.575572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf2b17-c296-4651-9a33-b082a798dcbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:56.577229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf2b17-c296-4651-9a33-b082a798dcbe service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:56.586991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 699/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:58.425435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe22603-fba1-49a9-8aff-9779efe85f91 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:58.426060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe22603-fba1-49a9-8aff-9779efe85f91 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:58.426060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe22603-fba1-49a9-8aff-9779efe85f91 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:58.427371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 696/1395] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:58.432730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeee584-adb6-4554-98a8-4b099b2015a2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:58.433171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeee584-adb6-4554-98a8-4b099b2015a2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:58.433289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeee584-adb6-4554-98a8-4b099b2015a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:58.452364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4eeee584-adb6-4554-98a8-4b099b2015a2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:58.453568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4eeee584-adb6-4554-98a8-4b099b2015a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:58.462779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 700/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:58.518657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31f2e-2864-4f6e-b7ff-0070ecaf6cdb None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:58.518945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31f2e-2864-4f6e-b7ff-0070ecaf6cdb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:58.519234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31f2e-2864-4f6e-b7ff-0070ecaf6cdb None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:58.520918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 697/1397] 10.222.0.49 () {54 vars in 962 bytes} [Tue Jun 28 12:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:58.525948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f72f3a-02df-4d72-8b70-bf0eb961133d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:58.526246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f72f3a-02df-4d72-8b70-bf0eb961133d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:58.526524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f72f3a-02df-4d72-8b70-bf0eb961133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:58.575711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-11f72f3a-02df-4d72-8b70-bf0eb961133d None None] MFA Rules not processed for user `6784d862961b44f48b385bec777ac439`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:58.576942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11f72f3a-02df-4d72-8b70-bf0eb961133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:58.638086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 701/1398] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Jun 28 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:58.645569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31f2e-2864-4f6e-b7ff-0070ecaf6cdb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:58.656782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31f2e-2864-4f6e-b7ff-0070ecaf6cdb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:58.660288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ee82d-3846-4e70-afae-fc02f7fbd1ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6784d862961b44f48b385bec777ac439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:58.660922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ee82d-3846-4e70-afae-fc02f7fbd1ab service glance] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:58.661202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ee82d-3846-4e70-afae-fc02f7fbd1ab service glance] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:58.661474 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ee82d-3846-4e70-afae-fc02f7fbd1ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:58.670501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ee82d-3846-4e70-afae-fc02f7fbd1ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:58.671957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ee82d-3846-4e70-afae-fc02f7fbd1ab service glance] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:58.681749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 698/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:06:58.793235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fe1fc-ee2d-485e-ab5b-3503f1af485f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:58.793525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fe1fc-ee2d-485e-ab5b-3503f1af485f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:58.793809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fe1fc-ee2d-485e-ab5b-3503f1af485f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:58.795187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 702/1400] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:58.800437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43970c4a-ce3a-4c8b-9051-8e9b4d9880b0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:58.800821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43970c4a-ce3a-4c8b-9051-8e9b4d9880b0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:58.801155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43970c4a-ce3a-4c8b-9051-8e9b4d9880b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:58.820090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-43970c4a-ce3a-4c8b-9051-8e9b4d9880b0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:58.821371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-43970c4a-ce3a-4c8b-9051-8e9b4d9880b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:58.829491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 699/1401] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:58.875548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fe1fc-ee2d-485e-ab5b-3503f1af485f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:58.891479 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fe1fc-ee2d-485e-ab5b-3503f1af485f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:58.897283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85507735-8488-4a62-a492-cf13debc7bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:58.898032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85507735-8488-4a62-a492-cf13debc7bb3 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:58.898317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85507735-8488-4a62-a492-cf13debc7bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:58.898598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85507735-8488-4a62-a492-cf13debc7bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:58.909050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85507735-8488-4a62-a492-cf13debc7bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:58.910678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85507735-8488-4a62-a492-cf13debc7bb3 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:58.921995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 703/1402] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:06:59.583952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7216cd-6d5f-4762-a0c1-7a84841d2903 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:59.584397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7216cd-6d5f-4762-a0c1-7a84841d2903 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:59.584565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7216cd-6d5f-4762-a0c1-7a84841d2903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:59.634717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9e7216cd-6d5f-4762-a0c1-7a84841d2903 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:59.635998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9e7216cd-6d5f-4762-a0c1-7a84841d2903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:59.698970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 700/1403] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:06:59.743632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca1573-984c-4c4b-a7c7-5c6bee122da1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:59.744196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca1573-984c-4c4b-a7c7-5c6bee122da1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:59.744363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca1573-984c-4c4b-a7c7-5c6bee122da1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:59.745761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 704/1404] 10.222.0.49 () {54 vars in 942 bytes} [Tue Jun 28 12:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:06:59.751989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a943-cf62-4e14-af90-c7322f5a3a4d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:59.752276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a943-cf62-4e14-af90-c7322f5a3a4d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:59.752549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652a943-cf62-4e14-af90-c7322f5a3a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:59.801069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d652a943-cf62-4e14-af90-c7322f5a3a4d None None] MFA Rules not processed for user `66e90e70937d49c8a35928fcfc90972d`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:06:59.802274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d652a943-cf62-4e14-af90-c7322f5a3a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:06:59.837068 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:59.876055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 701/1405] 10.222.0.49 () {58 vars in 1039 bytes} [Tue Jun 28 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:06:59.885586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca1573-984c-4c4b-a7c7-5c6bee122da1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:06:59.893164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:06:59.899504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca1573-984c-4c4b-a7c7-5c6bee122da1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:06:59.904612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b648eb6-bedd-4299-98e7-b04736a0b4ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:06:59.905251 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648eb6-bedd-4299-98e7-b04736a0b4ff service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:06:59.905540 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648eb6-bedd-4299-98e7-b04736a0b4ff service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:06:59.905820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648eb6-bedd-4299-98e7-b04736a0b4ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:06:59.913857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b648eb6-bedd-4299-98e7-b04736a0b4ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:06:59.916109 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b648eb6-bedd-4299-98e7-b04736a0b4ff service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:06:59.924807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 705/1406] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:06:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:07:01.158976 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d9a4-25b7-4073-a56b-4320c6e89ca7 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:01.159516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d9a4-25b7-4073-a56b-4320c6e89ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:01.159516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d9a4-25b7-4073-a56b-4320c6e89ca7 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:01.161104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 702/1407] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:01.166707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6733fef-2cfe-4c80-81d1-41524a8dfa6f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:01.167162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6733fef-2cfe-4c80-81d1-41524a8dfa6f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:01.167289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6733fef-2cfe-4c80-81d1-41524a8dfa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:01.185744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a6733fef-2cfe-4c80-81d1-41524a8dfa6f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:01.186962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a6733fef-2cfe-4c80-81d1-41524a8dfa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:01.195116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 706/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:07:01.239019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4d9a4-25b7-4073-a56b-4320c6e89ca7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:01.255147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4d9a4-25b7-4073-a56b-4320c6e89ca7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:01.265315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab563a01-9574-4681-95b6-5d69194b3fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:01.266008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab563a01-9574-4681-95b6-5d69194b3fad service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:01.266289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab563a01-9574-4681-95b6-5d69194b3fad service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:01.266562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab563a01-9574-4681-95b6-5d69194b3fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:01.275619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab563a01-9574-4681-95b6-5d69194b3fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:01.277230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab563a01-9574-4681-95b6-5d69194b3fad service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:01.286754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 703/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:11.179653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=8 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:11.282478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=21 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:23.665308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc51ca-0880-4bf4-a16b-5c3f9c3e7ea7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:23.665899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc51ca-0880-4bf4-a16b-5c3f9c3e7ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:23.665899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc51ca-0880-4bf4-a16b-5c3f9c3e7ea7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:23.667267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 707/1410] 10.222.0.49 () {54 vars in 918 bytes} [Tue Jun 28 12:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:23.672429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bbbe4-c750-458c-993d-50d366b26d7e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:23.672851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bbbe4-c750-458c-993d-50d366b26d7e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:23.672987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bbbe4-c750-458c-993d-50d366b26d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:23.690604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e06bbbe4-c750-458c-993d-50d366b26d7e None None] MFA Rules not processed for user `c7db581dec064fe0afeb4be5838470bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:23.691794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e06bbbe4-c750-458c-993d-50d366b26d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:23.700775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 704/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jun 28 12:07:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:23.715598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52722-38bb-4372-a8b3-5876c038ed3c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:23.715915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52722-38bb-4372-a8b3-5876c038ed3c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:23.716196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52722-38bb-4372-a8b3-5876c038ed3c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:23.717543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 708/1412] 10.222.0.49 () {54 vars in 918 bytes} [Tue Jun 28 12:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:23.722143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d5b46-40c9-45f5-a9f2-b3123f801cad None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:23.722424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d5b46-40c9-45f5-a9f2-b3123f801cad None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:23.722698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d5b46-40c9-45f5-a9f2-b3123f801cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:23.739740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7f4d5b46-40c9-45f5-a9f2-b3123f801cad None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:23.740936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7f4d5b46-40c9-45f5-a9f2-b3123f801cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:23.750321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 705/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jun 28 12:07:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:07:26.251175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a9db-12de-4c9a-917a-4aa5491ed9a8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:26.251749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a9db-12de-4c9a-917a-4aa5491ed9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:26.251749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613a9db-12de-4c9a-917a-4aa5491ed9a8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:26.253121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:26.259023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4f56-ce62-43b6-b5b2-ee841e932eb2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:26.259427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4f56-ce62-43b6-b5b2-ee841e932eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:26.259561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c4f56-ce62-43b6-b5b2-ee841e932eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:26.276884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7b7c4f56-ce62-43b6-b5b2-ee841e932eb2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:26.278072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7b7c4f56-ce62-43b6-b5b2-ee841e932eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:26.285743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:26.329143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613a9db-12de-4c9a-917a-4aa5491ed9a8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:26.343769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613a9db-12de-4c9a-917a-4aa5491ed9a8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:26.349308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601ffe8-9213-4c87-925c-f669f3ff8a01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:26.349942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601ffe8-9213-4c87-925c-f669f3ff8a01 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:26.350230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601ffe8-9213-4c87-925c-f669f3ff8a01 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:26.350512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601ffe8-9213-4c87-925c-f669f3ff8a01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:26.358806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601ffe8-9213-4c87-925c-f669f3ff8a01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:26.360423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601ffe8-9213-4c87-925c-f669f3ff8a01 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:26.370562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 710/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:27.289908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3eab-36ca-4288-8c60-9bb1cf3ce4e2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:27.290477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3eab-36ca-4288-8c60-9bb1cf3ce4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:27.290477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3eab-36ca-4288-8c60-9bb1cf3ce4e2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:27.291842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:27.296804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893a436-e2c4-4c76-9694-7e8047aa6053 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:27.297215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893a436-e2c4-4c76-9694-7e8047aa6053 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:27.297368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893a436-e2c4-4c76-9694-7e8047aa6053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:27.315561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c893a436-e2c4-4c76-9694-7e8047aa6053 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:27.316799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c893a436-e2c4-4c76-9694-7e8047aa6053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:27.325555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:27.477710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c3eab-36ca-4288-8c60-9bb1cf3ce4e2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:27.492469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c3eab-36ca-4288-8c60-9bb1cf3ce4e2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:27.497878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43631560-c024-4ea6-969d-e56597135b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:27.498515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43631560-c024-4ea6-969d-e56597135b4b service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:27.498822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43631560-c024-4ea6-969d-e56597135b4b service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:27.499097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43631560-c024-4ea6-969d-e56597135b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:27.507309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43631560-c024-4ea6-969d-e56597135b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:27.509091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43631560-c024-4ea6-969d-e56597135b4b service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:27.518670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 708/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:28.403318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f22fe-a1e6-44cf-ba40-98ca39136c4d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:28.403993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f22fe-a1e6-44cf-ba40-98ca39136c4d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:28.403993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f22fe-a1e6-44cf-ba40-98ca39136c4d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:28.405288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:28.410325 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862aa0f-6d06-4e40-a289-0f755b51240b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:28.410760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862aa0f-6d06-4e40-a289-0f755b51240b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:28.410862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862aa0f-6d06-4e40-a289-0f755b51240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:28.429944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7862aa0f-6d06-4e40-a289-0f755b51240b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:28.431139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7862aa0f-6d06-4e40-a289-0f755b51240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:28.438852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:28.593523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f22fe-a1e6-44cf-ba40-98ca39136c4d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:28.608173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f22fe-a1e6-44cf-ba40-98ca39136c4d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:28.613490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfe319-b408-4e31-9fd8-731f174f62c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:28.614119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe319-b408-4e31-9fd8-731f174f62c9 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:28.614400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe319-b408-4e31-9fd8-731f174f62c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:28.614676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe319-b408-4e31-9fd8-731f174f62c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:28.622629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfe319-b408-4e31-9fd8-731f174f62c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:28.624261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfe319-b408-4e31-9fd8-731f174f62c9 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:28.633421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 713/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:29.490270 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347fee3-2747-4aa1-9599-e7543da8cc2c None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:29.490862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347fee3-2747-4aa1-9599-e7543da8cc2c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:29.490862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347fee3-2747-4aa1-9599-e7543da8cc2c None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:29.492601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:29.497571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9a8fd-ce81-4a79-8e84-4c15e466cb68 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:29.498001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9a8fd-ce81-4a79-8e84-4c15e466cb68 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:29.498129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9a8fd-ce81-4a79-8e84-4c15e466cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:29.516093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6ed9a8fd-ce81-4a79-8e84-4c15e466cb68 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:29.517317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ed9a8fd-ce81-4a79-8e84-4c15e466cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:29.526055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:29.679790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347fee3-2747-4aa1-9599-e7543da8cc2c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:29.693783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347fee3-2747-4aa1-9599-e7543da8cc2c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:29.699730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d84613-7c4f-4805-a68e-c117fc29773c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:29.700390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84613-7c4f-4805-a68e-c117fc29773c service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:29.700674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84613-7c4f-4805-a68e-c117fc29773c service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:29.700950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84613-7c4f-4805-a68e-c117fc29773c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:29.709150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d84613-7c4f-4805-a68e-c117fc29773c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:29.711318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d84613-7c4f-4805-a68e-c117fc29773c service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:29.721229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 711/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:30.650113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6871-76e9-4346-b8fd-2925810ac8e1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:30.650650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6871-76e9-4346-b8fd-2925810ac8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:30.650785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6871-76e9-4346-b8fd-2925810ac8e1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:30.652090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:30.656875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befd683-5ade-47eb-806f-26d5579c69aa None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:30.657276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befd683-5ade-47eb-806f-26d5579c69aa None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:30.657417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befd683-5ade-47eb-806f-26d5579c69aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:30.675779 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5befd683-5ade-47eb-806f-26d5579c69aa None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:30.677051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5befd683-5ade-47eb-806f-26d5579c69aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:30.685562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:30.836254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6871-76e9-4346-b8fd-2925810ac8e1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:30.850400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6871-76e9-4346-b8fd-2925810ac8e1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:30.856587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f9671-d874-4d0f-a551-c0292d0017c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:30.857221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f9671-d874-4d0f-a551-c0292d0017c1 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:30.857506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f9671-d874-4d0f-a551-c0292d0017c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:30.857785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f9671-d874-4d0f-a551-c0292d0017c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:30.865890 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f9671-d874-4d0f-a551-c0292d0017c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:30.867606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f9671-d874-4d0f-a551-c0292d0017c1 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:30.877022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 716/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:31.782636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc876e-905c-4eee-ba18-5cc1f8968e1b None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:31.783161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc876e-905c-4eee-ba18-5cc1f8968e1b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:31.783161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc876e-905c-4eee-ba18-5cc1f8968e1b None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:31.784525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:31.789837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf0a4-4dd5-4495-9261-f399b6ddde22 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:31.790239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf0a4-4dd5-4495-9261-f399b6ddde22 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:31.790401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf0a4-4dd5-4495-9261-f399b6ddde22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:31.808841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-35ddf0a4-4dd5-4495-9261-f399b6ddde22 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:31.810049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-35ddf0a4-4dd5-4495-9261-f399b6ddde22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:31.817955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:07:31.970688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc876e-905c-4eee-ba18-5cc1f8968e1b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:31.985457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc876e-905c-4eee-ba18-5cc1f8968e1b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:31.990802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55e477-fe11-415b-a717-e8da7b638eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:31.992057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55e477-fe11-415b-a717-e8da7b638eec service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:31.992343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55e477-fe11-415b-a717-e8da7b638eec service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:31.992618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55e477-fe11-415b-a717-e8da7b638eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:32.000666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55e477-fe11-415b-a717-e8da7b638eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:32.002236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55e477-fe11-415b-a717-e8da7b638eec service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:32.011584 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 714/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:32.883990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fc8f9-2cfe-4a5f-8086-2da60686c7a5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:32.884523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fc8f9-2cfe-4a5f-8086-2da60686c7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:32.884642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fc8f9-2cfe-4a5f-8086-2da60686c7a5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:32.885966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:32.891088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de141be2-2751-4e58-8b17-baf35268442d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:32.891485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de141be2-2751-4e58-8b17-baf35268442d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:32.891637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de141be2-2751-4e58-8b17-baf35268442d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:32.910102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-de141be2-2751-4e58-8b17-baf35268442d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:32.911297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-de141be2-2751-4e58-8b17-baf35268442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:32.919194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:33.070328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fc8f9-2cfe-4a5f-8086-2da60686c7a5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:33.085534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fc8f9-2cfe-4a5f-8086-2da60686c7a5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:33.091011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7bbd8-fafc-470a-8cb1-abd27f05ddb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:33.091647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7bbd8-fafc-470a-8cb1-abd27f05ddb5 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:33.091972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7bbd8-fafc-470a-8cb1-abd27f05ddb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:33.092258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7bbd8-fafc-470a-8cb1-abd27f05ddb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:33.102913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7bbd8-fafc-470a-8cb1-abd27f05ddb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:33.104547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7bbd8-fafc-470a-8cb1-abd27f05ddb5 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:33.114052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 719/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:33.979394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda8b3-890e-47ae-835a-2d1d91015b40 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:33.979810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda8b3-890e-47ae-835a-2d1d91015b40 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:33.979978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cda8b3-890e-47ae-835a-2d1d91015b40 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:33.981360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:33.986330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47641e15-30bc-4112-854a-ba77128e50a0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:33.986725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47641e15-30bc-4112-854a-ba77128e50a0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:33.986889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47641e15-30bc-4112-854a-ba77128e50a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:34.005227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-47641e15-30bc-4112-854a-ba77128e50a0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:34.006422 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-47641e15-30bc-4112-854a-ba77128e50a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:34.014926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:34.165577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda8b3-890e-47ae-835a-2d1d91015b40 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:34.180183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cda8b3-890e-47ae-835a-2d1d91015b40 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:34.185365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27515-c890-4082-9ed3-2cbafe4b3249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:34.186007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27515-c890-4082-9ed3-2cbafe4b3249 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:34.186268 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27515-c890-4082-9ed3-2cbafe4b3249 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:34.186538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27515-c890-4082-9ed3-2cbafe4b3249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:34.194515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb27515-c890-4082-9ed3-2cbafe4b3249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:34.196107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb27515-c890-4082-9ed3-2cbafe4b3249 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:34.205772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 717/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:35.081410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c2fe5-d941-45a2-9f0b-80f3fed6e3d0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:35.083530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c2fe5-d941-45a2-9f0b-80f3fed6e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:35.083530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c2fe5-d941-45a2-9f0b-80f3fed6e3d0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:35.083530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:35.089163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6c84-3bae-4ea7-94e0-023378d205a1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:35.089642 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6c84-3bae-4ea7-94e0-023378d205a1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:35.089748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6c84-3bae-4ea7-94e0-023378d205a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:35.107462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5eed6c84-3bae-4ea7-94e0-023378d205a1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:35.112326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5eed6c84-3bae-4ea7-94e0-023378d205a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:35.116590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:07:35.269129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c2fe5-d941-45a2-9f0b-80f3fed6e3d0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:35.284154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c2fe5-d941-45a2-9f0b-80f3fed6e3d0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:35.289627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b312e-b9bf-4d62-81a5-3f34071b4825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:35.290268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b312e-b9bf-4d62-81a5-3f34071b4825 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:35.290554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b312e-b9bf-4d62-81a5-3f34071b4825 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:35.290833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b312e-b9bf-4d62-81a5-3f34071b4825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:35.298980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b312e-b9bf-4d62-81a5-3f34071b4825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:35.300602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b312e-b9bf-4d62-81a5-3f34071b4825 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:35.310878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 722/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:37.233975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d75ba-ed7e-4c4a-a7ae-6b30a48ba3b0 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:37.234559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d75ba-ed7e-4c4a-a7ae-6b30a48ba3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:37.234559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d75ba-ed7e-4c4a-a7ae-6b30a48ba3b0 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:37.235918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:37.241109 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85b3c-bc8b-439e-aab0-de1d5966ff73 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:37.241519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85b3c-bc8b-439e-aab0-de1d5966ff73 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:37.241655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85b3c-bc8b-439e-aab0-de1d5966ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:37.259292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0cd85b3c-bc8b-439e-aab0-de1d5966ff73 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:37.260502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0cd85b3c-bc8b-439e-aab0-de1d5966ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:37.268197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:37.306948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d75ba-ed7e-4c4a-a7ae-6b30a48ba3b0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:37.317605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d75ba-ed7e-4c4a-a7ae-6b30a48ba3b0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:37.322064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555c782-5954-47ff-9b87-c396e2905ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:37.322697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555c782-5954-47ff-9b87-c396e2905ced service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:37.322982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555c782-5954-47ff-9b87-c396e2905ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:37.323259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555c782-5954-47ff-9b87-c396e2905ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:37.332405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555c782-5954-47ff-9b87-c396e2905ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:37.333830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555c782-5954-47ff-9b87-c396e2905ced service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:37.344229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 720/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:39.616683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaf0e2-091a-4416-b913-69a79d1551d5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:39.617204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaf0e2-091a-4416-b913-69a79d1551d5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:39.617300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaf0e2-091a-4416-b913-69a79d1551d5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:39.618693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 12:07:39.623954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638714a6-7e24-4ede-ac08-ba057d9c4109 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:39.624389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638714a6-7e24-4ede-ac08-ba057d9c4109 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:39.624489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638714a6-7e24-4ede-ac08-ba057d9c4109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:39.643145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-638714a6-7e24-4ede-ac08-ba057d9c4109 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:39.645224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-638714a6-7e24-4ede-ac08-ba057d9c4109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:39.652855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:39.690746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaf0e2-091a-4416-b913-69a79d1551d5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:39.702210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaf0e2-091a-4416-b913-69a79d1551d5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:39.705962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ed3fd-3f81-4261-b437-f0eab444cd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:39.706597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ed3fd-3f81-4261-b437-f0eab444cd3e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:39.706886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ed3fd-3f81-4261-b437-f0eab444cd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:39.707166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ed3fd-3f81-4261-b437-f0eab444cd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:39.716733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ed3fd-3f81-4261-b437-f0eab444cd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:39.718161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ed3fd-3f81-4261-b437-f0eab444cd3e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:39.727924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 725/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:42.136145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671a684-7080-4afa-9013-81b803bbc426 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:42.136702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671a684-7080-4afa-9013-81b803bbc426 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:42.136702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671a684-7080-4afa-9013-81b803bbc426 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:42.138066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:42.143294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0ea5-2515-465e-851c-447b4cf66449 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:42.143678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0ea5-2515-465e-851c-447b4cf66449 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:42.143856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0ea5-2515-465e-851c-447b4cf66449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:42.161945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-665e0ea5-2515-465e-851c-447b4cf66449 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:42.163787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-665e0ea5-2515-465e-851c-447b4cf66449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:42.171512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:42.210764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671a684-7080-4afa-9013-81b803bbc426 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:42.221395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671a684-7080-4afa-9013-81b803bbc426 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:42.224927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8621bff-d8e9-49ae-a44e-36e291658335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:42.226120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8621bff-d8e9-49ae-a44e-36e291658335 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:42.226400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8621bff-d8e9-49ae-a44e-36e291658335 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:42.226674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8621bff-d8e9-49ae-a44e-36e291658335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:42.235519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8621bff-d8e9-49ae-a44e-36e291658335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:42.236921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8621bff-d8e9-49ae-a44e-36e291658335 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:42.246424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 723/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:44.407292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c58d20-64eb-4816-b079-c1be6728ff6f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:44.407820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c58d20-64eb-4816-b079-c1be6728ff6f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:44.407979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c58d20-64eb-4816-b079-c1be6728ff6f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:44.409405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:44.414746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e44948-03e7-42b2-889f-b07103fdf8b9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:44.415159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e44948-03e7-42b2-889f-b07103fdf8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:44.415305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e44948-03e7-42b2-889f-b07103fdf8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:44.433569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c3e44948-03e7-42b2-889f-b07103fdf8b9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:44.434774 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c3e44948-03e7-42b2-889f-b07103fdf8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:44.442760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:44.482252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c58d20-64eb-4816-b079-c1be6728ff6f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:44.483992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-97c58d20-64eb-4816-b079-c1be6728ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:44.497649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c58d20-64eb-4816-b079-c1be6728ff6f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:44.501145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca511df-2c33-4c62-9fcf-a3978c1a5e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:44.501781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca511df-2c33-4c62-9fcf-a3978c1a5e51 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:44.502066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca511df-2c33-4c62-9fcf-a3978c1a5e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:44.502348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca511df-2c33-4c62-9fcf-a3978c1a5e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:44.512305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca511df-2c33-4c62-9fcf-a3978c1a5e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:44.513730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca511df-2c33-4c62-9fcf-a3978c1a5e51 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:44.523208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 728/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:46.665850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa30ca-1947-456d-9a31-a0194b91f28d None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:46.666424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa30ca-1947-456d-9a31-a0194b91f28d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:46.666424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa30ca-1947-456d-9a31-a0194b91f28d None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:46.667843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:46.673108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412a4f-8f66-410d-bbb9-3ea44dc7e10c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:46.673531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412a4f-8f66-410d-bbb9-3ea44dc7e10c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:46.673664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412a4f-8f66-410d-bbb9-3ea44dc7e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:46.691045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-83412a4f-8f66-410d-bbb9-3ea44dc7e10c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:46.692271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83412a4f-8f66-410d-bbb9-3ea44dc7e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:46.700082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:46.738828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa30ca-1947-456d-9a31-a0194b91f28d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:46.749556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa30ca-1947-456d-9a31-a0194b91f28d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:46.753014 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23792351-2fae-4b64-ad03-84af2b7d98fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:46.753648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792351-2fae-4b64-ad03-84af2b7d98fa service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:46.753931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792351-2fae-4b64-ad03-84af2b7d98fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:46.754209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792351-2fae-4b64-ad03-84af2b7d98fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:46.763092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23792351-2fae-4b64-ad03-84af2b7d98fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:46.764549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23792351-2fae-4b64-ad03-84af2b7d98fa service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:46.774452 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 726/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:48.911668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168647-c5a1-4727-83b2-63ddc506595c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:48.912255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168647-c5a1-4727-83b2-63ddc506595c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:48.912255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168647-c5a1-4727-83b2-63ddc506595c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:48.913660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:48.918768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8682e-987a-47d9-a9c9-cd241b154414 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:48.919172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8682e-987a-47d9-a9c9-cd241b154414 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:48.919315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8682e-987a-47d9-a9c9-cd241b154414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:48.937063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ddd8682e-987a-47d9-a9c9-cd241b154414 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:48.938244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ddd8682e-987a-47d9-a9c9-cd241b154414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:48.946672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:48.985101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06168647-c5a1-4727-83b2-63ddc506595c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:48.996174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06168647-c5a1-4727-83b2-63ddc506595c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:48.999609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790deb17-3fd4-46e0-a88a-da8f90488f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:49.000276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790deb17-3fd4-46e0-a88a-da8f90488f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:49.000557 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790deb17-3fd4-46e0-a88a-da8f90488f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:49.000827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790deb17-3fd4-46e0-a88a-da8f90488f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:49.010179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790deb17-3fd4-46e0-a88a-da8f90488f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:49.011596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790deb17-3fd4-46e0-a88a-da8f90488f41 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:49.020761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 731/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:51.126272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147ac5b-d592-4c8c-8fac-473c28f970d3 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:51.126812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147ac5b-d592-4c8c-8fac-473c28f970d3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:51.126812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147ac5b-d592-4c8c-8fac-473c28f970d3 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:51.128244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:51.134369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930faf0-0274-4ecf-b26a-8fcbd8fe0ee0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:51.134775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930faf0-0274-4ecf-b26a-8fcbd8fe0ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:51.134932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930faf0-0274-4ecf-b26a-8fcbd8fe0ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:51.153152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f930faf0-0274-4ecf-b26a-8fcbd8fe0ee0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:51.154347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f930faf0-0274-4ecf-b26a-8fcbd8fe0ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:51.162080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:51.200772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147ac5b-d592-4c8c-8fac-473c28f970d3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:51.211741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147ac5b-d592-4c8c-8fac-473c28f970d3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:51.215267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a5982-a1a3-46ae-9d1b-c1c036b50e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:51.215919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a5982-a1a3-46ae-9d1b-c1c036b50e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:51.216208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a5982-a1a3-46ae-9d1b-c1c036b50e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:51.216483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a5982-a1a3-46ae-9d1b-c1c036b50e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:51.225417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a5982-a1a3-46ae-9d1b-c1c036b50e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:51.226919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a5982-a1a3-46ae-9d1b-c1c036b50e18 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:51.236347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 729/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:53.318123 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9181-8d1e-434d-b32f-190836614a2d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:53.319347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9181-8d1e-434d-b32f-190836614a2d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:53.319347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed9181-8d1e-434d-b32f-190836614a2d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:53.320687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:53.326244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3058e0-6471-4199-9701-8fd2d7b96944 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:53.326671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3058e0-6471-4199-9701-8fd2d7b96944 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:53.326801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3058e0-6471-4199-9701-8fd2d7b96944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:53.333058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=79 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:53.345561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-cb3058e0-6471-4199-9701-8fd2d7b96944 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:53.346746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cb3058e0-6471-4199-9701-8fd2d7b96944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:53.354537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:53.391624 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed9181-8d1e-434d-b32f-190836614a2d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:53.397630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=73 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:07:53.403304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed9181-8d1e-434d-b32f-190836614a2d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:53.406772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be9f1-a5b9-4c93-a8ab-2cc62ffebfff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:53.407402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be9f1-a5b9-4c93-a8ab-2cc62ffebfff service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:53.407681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be9f1-a5b9-4c93-a8ab-2cc62ffebfff service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:53.407998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be9f1-a5b9-4c93-a8ab-2cc62ffebfff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:53.417518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8be9f1-a5b9-4c93-a8ab-2cc62ffebfff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:53.418923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8be9f1-a5b9-4c93-a8ab-2cc62ffebfff service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:53.429053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 734/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:55.509176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aec55-5306-47aa-92f7-9795cc945a28 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:55.509713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aec55-5306-47aa-92f7-9795cc945a28 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:55.509713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aec55-5306-47aa-92f7-9795cc945a28 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:55.511089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:55.516335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f740e00-ec61-4574-a610-5be8bb9b208e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:55.516725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f740e00-ec61-4574-a610-5be8bb9b208e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:55.516887 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f740e00-ec61-4574-a610-5be8bb9b208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:55.534889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9f740e00-ec61-4574-a610-5be8bb9b208e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:55.536112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9f740e00-ec61-4574-a610-5be8bb9b208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:55.543839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:55.581318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064aec55-5306-47aa-92f7-9795cc945a28 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:55.591764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064aec55-5306-47aa-92f7-9795cc945a28 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:55.595253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1a28f-34d5-412a-8f27-90d3f3111eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:55.595905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1a28f-34d5-412a-8f27-90d3f3111eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:55.596194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1a28f-34d5-412a-8f27-90d3f3111eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:55.596469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1a28f-34d5-412a-8f27-90d3f3111eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:55.605527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1a28f-34d5-412a-8f27-90d3f3111eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:55.606954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1a28f-34d5-412a-8f27-90d3f3111eb2 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:55.616905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 732/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:07:57.692014 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ccd66-6cef-464b-b45d-917571f43b98 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:57.692574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ccd66-6cef-464b-b45d-917571f43b98 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:57.692574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ccd66-6cef-464b-b45d-917571f43b98 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:57.694134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:07:57.699597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6a9ee-aeb2-4f9b-9ed5-bb7068ed4263 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:57.700067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6a9ee-aeb2-4f9b-9ed5-bb7068ed4263 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:57.700167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6a9ee-aeb2-4f9b-9ed5-bb7068ed4263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:57.718525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fdc6a9ee-aeb2-4f9b-9ed5-bb7068ed4263 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:07:57.719713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fdc6a9ee-aeb2-4f9b-9ed5-bb7068ed4263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:07:57.728330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:07:57.764368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ccd66-6cef-464b-b45d-917571f43b98 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:07:57.775630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ccd66-6cef-464b-b45d-917571f43b98 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:07:57.779089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21444b53-054a-47d5-b147-649fefd57d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:07:57.779726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444b53-054a-47d5-b147-649fefd57d96 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:07:57.780049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444b53-054a-47d5-b147-649fefd57d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:07:57.780333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444b53-054a-47d5-b147-649fefd57d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:07:57.789997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21444b53-054a-47d5-b147-649fefd57d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:07:57.791411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21444b53-054a-47d5-b147-649fefd57d96 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:07:57.800720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 737/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:08:07.713475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=11 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:07.796605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=14 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:17.710309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2910c5-4677-4bc7-8ad6-2321947a2226 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:17.710874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2910c5-4677-4bc7-8ad6-2321947a2226 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:17.710874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2910c5-4677-4bc7-8ad6-2321947a2226 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:17.712257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 734/1471] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:08:17.717674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0a9ee-e042-4693-b7a3-c9255d8439db None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:17.718096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0a9ee-e042-4693-b7a3-c9255d8439db None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:17.718235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0a9ee-e042-4693-b7a3-c9255d8439db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:17.736410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f2a0a9ee-e042-4693-b7a3-c9255d8439db None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:08:17.737635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f2a0a9ee-e042-4693-b7a3-c9255d8439db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:08:17.746112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 738/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:08:17.793102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795877b6-c0c2-46e0-af43-cfb77da56af7 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:17.793389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795877b6-c0c2-46e0-af43-cfb77da56af7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:17.793663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795877b6-c0c2-46e0-af43-cfb77da56af7 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:17.795017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 735/1473] 10.222.0.49 () {54 vars in 962 bytes} [Tue Jun 28 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:08:17.799640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c4318-3071-4597-bcdb-a07bfce3cedb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:17.799958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c4318-3071-4597-bcdb-a07bfce3cedb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:17.800242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c4318-3071-4597-bcdb-a07bfce3cedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:17.818567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-077c4318-3071-4597-bcdb-a07bfce3cedb None None] MFA Rules not processed for user `6784d862961b44f48b385bec777ac439`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:08:17.819749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-077c4318-3071-4597-bcdb-a07bfce3cedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:08:17.826071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 739/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Tue Jun 28 12:08:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:08:17.833346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795877b6-c0c2-46e0-af43-cfb77da56af7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:08:17.843609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795877b6-c0c2-46e0-af43-cfb77da56af7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:08:17.847069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d968b09-eafc-47cf-97fa-6b59aa923cb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6784d862961b44f48b385bec777ac439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:08:17.847684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968b09-eafc-47cf-97fa-6b59aa923cb8 service glance] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:17.848001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968b09-eafc-47cf-97fa-6b59aa923cb8 service glance] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:17.848275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d968b09-eafc-47cf-97fa-6b59aa923cb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:17.857481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d968b09-eafc-47cf-97fa-6b59aa923cb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:08:17.858890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d968b09-eafc-47cf-97fa-6b59aa923cb8 service glance] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:08:17.868796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 736/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:08:20.007321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c5804-ed4c-44e1-beb7-3490e9c1480e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:20.007767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c5804-ed4c-44e1-beb7-3490e9c1480e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:20.007910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c5804-ed4c-44e1-beb7-3490e9c1480e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:20.009262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 740/1476] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:08:20.014342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39187-5464-445f-b1d5-d3cea8e9ff81 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:20.014800 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39187-5464-445f-b1d5-d3cea8e9ff81 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:20.014906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a39187-5464-445f-b1d5-d3cea8e9ff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:20.033067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-25a39187-5464-445f-b1d5-d3cea8e9ff81 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:08:20.034264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-25a39187-5464-445f-b1d5-d3cea8e9ff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:08:20.042414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 737/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:08:20.066500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c5804-ed4c-44e1-beb7-3490e9c1480e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:08:20.079691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c5804-ed4c-44e1-beb7-3490e9c1480e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:08:20.084819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61265167-cca7-420e-b824-065a4eb30752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:08:20.085469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265167-cca7-420e-b824-065a4eb30752 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:20.085754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265167-cca7-420e-b824-065a4eb30752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:20.086035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61265167-cca7-420e-b824-065a4eb30752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:20.086776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61265167-cca7-420e-b824-065a4eb30752 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:08:20.088631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-61265167-cca7-420e-b824-065a4eb30752 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:08:20.088631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 28 12:08:20.088631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: Jun 28 12:08:20.089790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61265167-cca7-420e-b824-065a4eb30752 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:08:20.109427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 741/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Tue Jun 28 12:08:20 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:08:22.156579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9987dc9-2316-44fd-bf07-bbc1cd9974c6 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:22.157132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9987dc9-2316-44fd-bf07-bbc1cd9974c6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:22.157132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9987dc9-2316-44fd-bf07-bbc1cd9974c6 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:22.158564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 738/1479] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:08:22.164280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00732066-2a07-4a6a-9bd6-519491771aaf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:22.164686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00732066-2a07-4a6a-9bd6-519491771aaf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:22.164912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00732066-2a07-4a6a-9bd6-519491771aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:22.182321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-00732066-2a07-4a6a-9bd6-519491771aaf None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:08:22.183515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-00732066-2a07-4a6a-9bd6-519491771aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:08:22.191179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 742/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:08:22.233740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9987dc9-2316-44fd-bf07-bbc1cd9974c6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:08:22.247726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9987dc9-2316-44fd-bf07-bbc1cd9974c6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:08:22.253262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e0bef-dafd-42ae-b46f-394d31ef4965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:08:22.253846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e0bef-dafd-42ae-b46f-394d31ef4965 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:22.254123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e0bef-dafd-42ae-b46f-394d31ef4965 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:22.254396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e0bef-dafd-42ae-b46f-394d31ef4965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:22.263240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e0bef-dafd-42ae-b46f-394d31ef4965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:08:22.264853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e0bef-dafd-42ae-b46f-394d31ef4965 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:08:22.274809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 739/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:08:24.502777 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382e50-9381-4174-9f10-d5b499f9ddb5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:24.503442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382e50-9381-4174-9f10-d5b499f9ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:24.503545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382e50-9381-4174-9f10-d5b499f9ddb5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:24.504932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 743/1482] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:08:24.510520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf726c7-3b6c-4dac-b1e1-95824403c506 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:24.510992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf726c7-3b6c-4dac-b1e1-95824403c506 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:24.511095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf726c7-3b6c-4dac-b1e1-95824403c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:24.529024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ebf726c7-3b6c-4dac-b1e1-95824403c506 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:08:24.530223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ebf726c7-3b6c-4dac-b1e1-95824403c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:08:24.538516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 740/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:08:24.574831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db382e50-9381-4174-9f10-d5b499f9ddb5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:08:24.585888 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db382e50-9381-4174-9f10-d5b499f9ddb5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:08:24.589371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d33fb-bc52-4fea-85f7-27de060a7369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:08:24.590005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d33fb-bc52-4fea-85f7-27de060a7369 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:24.590289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d33fb-bc52-4fea-85f7-27de060a7369 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:24.590568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d33fb-bc52-4fea-85f7-27de060a7369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:24.599983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d33fb-bc52-4fea-85f7-27de060a7369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:08:24.601404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d33fb-bc52-4fea-85f7-27de060a7369 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:08:24.610812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 744/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:08:26.699487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48be8d5-e2f8-4ac1-b93b-c56e9a3df886 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:26.700065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48be8d5-e2f8-4ac1-b93b-c56e9a3df886 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:26.700065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48be8d5-e2f8-4ac1-b93b-c56e9a3df886 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:26.701465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 741/1485] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:08:26.706818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c5796-0a52-4440-80ae-43a0bf3e70a0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:26.707229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c5796-0a52-4440-80ae-43a0bf3e70a0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:26.707378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c5796-0a52-4440-80ae-43a0bf3e70a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:26.725215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c48c5796-0a52-4440-80ae-43a0bf3e70a0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:08:26.726398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c48c5796-0a52-4440-80ae-43a0bf3e70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:08:26.734050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 745/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:08:26.771419 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48be8d5-e2f8-4ac1-b93b-c56e9a3df886 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:08:26.781910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48be8d5-e2f8-4ac1-b93b-c56e9a3df886 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:08:26.785310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bb53-3aff-40c4-af23-210405535b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:08:26.786540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bb53-3aff-40c4-af23-210405535b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:26.786791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bb53-3aff-40c4-af23-210405535b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:26.787064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bb53-3aff-40c4-af23-210405535b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:26.795764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bb53-3aff-40c4-af23-210405535b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:08:26.797215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bb53-3aff-40c4-af23-210405535b46 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:08:26.806916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 742/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:08:28.927424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b2a5-330a-4fd2-9a69-3dcbd06a1f0d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:28.928006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b2a5-330a-4fd2-9a69-3dcbd06a1f0d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:28.928006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b2a5-330a-4fd2-9a69-3dcbd06a1f0d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:28.929392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 746/1488] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:08:28.934647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa73ea-6d69-4f2a-8ee0-b2079d5212e5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:28.935055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa73ea-6d69-4f2a-8ee0-b2079d5212e5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:28.935207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa73ea-6d69-4f2a-8ee0-b2079d5212e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:28.953416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-edfa73ea-6d69-4f2a-8ee0-b2079d5212e5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:08:28.954617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-edfa73ea-6d69-4f2a-8ee0-b2079d5212e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:08:28.963279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 743/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:08:29.002530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b2a5-330a-4fd2-9a69-3dcbd06a1f0d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:08:29.013676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b2a5-330a-4fd2-9a69-3dcbd06a1f0d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:08:29.017162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478aebe-ece6-4a5b-a5c8-9cdd076930b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:08:29.017807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478aebe-ece6-4a5b-a5c8-9cdd076930b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:29.018098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478aebe-ece6-4a5b-a5c8-9cdd076930b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:29.018380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478aebe-ece6-4a5b-a5c8-9cdd076930b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:29.028038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478aebe-ece6-4a5b-a5c8-9cdd076930b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:08:29.029471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478aebe-ece6-4a5b-a5c8-9cdd076930b4 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:08:29.038963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 747/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:08:31.652338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e453e8-5da8-4b16-8c17-2c4e7a50b8d8 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:31.652946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e453e8-5da8-4b16-8c17-2c4e7a50b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:31.652946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e453e8-5da8-4b16-8c17-2c4e7a50b8d8 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:31.654300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 744/1491] 10.222.0.49 () {54 vars in 926 bytes} [Tue Jun 28 12:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:08:31.659713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3542f-da46-4450-97a9-40813e6495c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:31.660172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3542f-da46-4450-97a9-40813e6495c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:31.660316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3542f-da46-4450-97a9-40813e6495c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:31.678429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2ac3542f-da46-4450-97a9-40813e6495c0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:08:31.679631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2ac3542f-da46-4450-97a9-40813e6495c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:08:31.687348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 748/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Tue Jun 28 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:08:31.726913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e453e8-5da8-4b16-8c17-2c4e7a50b8d8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:08:31.737401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e453e8-5da8-4b16-8c17-2c4e7a50b8d8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:08:31.741671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849d17d-4f87-495f-a08e-c150d5e46b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:08:31.742304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849d17d-4f87-495f-a08e-c150d5e46b08 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:08:31.742588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849d17d-4f87-495f-a08e-c150d5e46b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:08:31.742863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849d17d-4f87-495f-a08e-c150d5e46b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:08:31.756295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849d17d-4f87-495f-a08e-c150d5e46b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:08:31.757726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849d17d-4f87-495f-a08e-c150d5e46b08 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:08:31.767034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 745/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:08:41.673417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=33 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:08:41.762825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=33 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:06.306650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffbdd1-8eb0-455e-afee-1a9a13df9d01 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:06.307244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffbdd1-8eb0-455e-afee-1a9a13df9d01 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:06.307244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffbdd1-8eb0-455e-afee-1a9a13df9d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:06.326001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-35ffbdd1-8eb0-455e-afee-1a9a13df9d01 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:10:06.327217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-35ffbdd1-8eb0-455e-afee-1a9a13df9d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:10:06.336039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 749/1494] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:10:06.344016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3671de-faab-40d9-bd3f-c271b186a688 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:06.344518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3671de-faab-40d9-bd3f-c271b186a688 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:06.344628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3671de-faab-40d9-bd3f-c271b186a688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:06.362437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0b3671de-faab-40d9-bd3f-c271b186a688 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:10:06.363640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0b3671de-faab-40d9-bd3f-c271b186a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:10:06.371497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 746/1495] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:10:06.376034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffbdd1-8eb0-455e-afee-1a9a13df9d01 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:06.386022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffbdd1-8eb0-455e-afee-1a9a13df9d01 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:06.390424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:06.391069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:06.391350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:06.391625 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:06.393135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:10:06.393416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:06.394418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:10:06.394418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 28 12:10:06.394418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: Jun 28 12:10:06.395304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:06.406456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 750/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:10:06.414507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3671de-faab-40d9-bd3f-c271b186a688 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:06.423539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3671de-faab-40d9-bd3f-c271b186a688 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:06.428142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27af868-770d-48c6-85b2-c36bdc90bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:06.428791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af868-770d-48c6-85b2-c36bdc90bb18 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:06.429078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af868-770d-48c6-85b2-c36bdc90bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:06.429364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27af868-770d-48c6-85b2-c36bdc90bb18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:06.430055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27af868-770d-48c6-85b2-c36bdc90bb18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:06.431820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WARNING py.warnings [None req-b27af868-770d-48c6-85b2-c36bdc90bb18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:10:06.431820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: warnings.warn(msg) Jun 28 12:10:06.431820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: Jun 28 12:10:06.433036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27af868-770d-48c6-85b2-c36bdc90bb18 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:06.525658 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 747/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:10:06 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:10:06.530010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:06.540249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61ef96-d702-4f97-9bc1-91168f7e3c67 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:06.596004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d11537-e91a-458d-a471-f3ec37b05d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:06.596770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d11537-e91a-458d-a471-f3ec37b05d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:06.597056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d11537-e91a-458d-a471-f3ec37b05d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:06.597332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d11537-e91a-458d-a471-f3ec37b05d59 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:06.598325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d11537-e91a-458d-a471-f3ec37b05d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:06.599344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-78d11537-e91a-458d-a471-f3ec37b05d59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:10:06.599344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 28 12:10:06.599344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: Jun 28 12:10:06.600584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d11537-e91a-458d-a471-f3ec37b05d59 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:06.707188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 751/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:10:06 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:10:06.711132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27af868-770d-48c6-85b2-c36bdc90bb18 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:06.721565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27af868-770d-48c6-85b2-c36bdc90bb18 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:06.726298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b4224-447f-4370-a33d-8050a7b80273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:06.726954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b4224-447f-4370-a33d-8050a7b80273 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:06.727233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b4224-447f-4370-a33d-8050a7b80273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:06.727504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b4224-447f-4370-a33d-8050a7b80273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:06.728262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b4224-447f-4370-a33d-8050a7b80273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:06.729290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WARNING py.warnings [None req-7b4b4224-447f-4370-a33d-8050a7b80273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:10:06.729290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: warnings.warn(msg) Jun 28 12:10:06.729290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: Jun 28 12:10:06.730169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b4224-447f-4370-a33d-8050a7b80273 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:06.743366 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 748/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:10:06.747310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d11537-e91a-458d-a471-f3ec37b05d59 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:06.757709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d11537-e91a-458d-a471-f3ec37b05d59 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:06.762214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eb50a-a738-4447-bad6-5eb7cfb578f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:06.762862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb50a-a738-4447-bad6-5eb7cfb578f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:06.763162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb50a-a738-4447-bad6-5eb7cfb578f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:06.763417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb50a-a738-4447-bad6-5eb7cfb578f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:06.764189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eb50a-a738-4447-bad6-5eb7cfb578f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:06.765167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-059eb50a-a738-4447-bad6-5eb7cfb578f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:10:06.765167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 28 12:10:06.765167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: Jun 28 12:10:06.766048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eb50a-a738-4447-bad6-5eb7cfb578f2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:06.779783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 752/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:10:06.783823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b4224-447f-4370-a33d-8050a7b80273 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:06.793474 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b4224-447f-4370-a33d-8050a7b80273 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:06.797946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e374d-2515-41be-a71d-9faaded9cf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:06.799438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e374d-2515-41be-a71d-9faaded9cf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:06.799724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e374d-2515-41be-a71d-9faaded9cf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:06.800040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e374d-2515-41be-a71d-9faaded9cf7e admin admin] PATH_INFO: `/v3/projects/da3a8cce3f3b4c9298100dba4aab4dce/users/7ac777d7c3f5405fb742ce9fc777b73a/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:06.814970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e374d-2515-41be-a71d-9faaded9cf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3a8cce3f3b4c9298100dba4aab4dce, user_id=7ac777d7c3f5405fb742ce9fc777b73a, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:06.816050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WARNING py.warnings [None req-233e374d-2515-41be-a71d-9faaded9cf7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:10:06.816050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: warnings.warn(msg) Jun 28 12:10:06.816050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: Jun 28 12:10:06.817962 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e374d-2515-41be-a71d-9faaded9cf7e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:06.889442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 749/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:10:06 2022] PUT /identity/v3/projects/da3a8cce3f3b4c9298100dba4aab4dce/users/7ac777d7c3f5405fb742ce9fc777b73a/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:10:06.900622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce415844-ce3a-4362-afd5-c44c8adec54e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:06.900913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce415844-ce3a-4362-afd5-c44c8adec54e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:06.901194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce415844-ce3a-4362-afd5-c44c8adec54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:06.927730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ce415844-ce3a-4362-afd5-c44c8adec54e None None] MFA Rules not processed for user `7ac777d7c3f5405fb742ce9fc777b73a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:10:06.928990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ce415844-ce3a-4362-afd5-c44c8adec54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:10:06.991861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 753/1502] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:10:07.005426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8f00c-45e4-44ee-a9f3-bc3688e6bdcb None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:07.005731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8f00c-45e4-44ee-a9f3-bc3688e6bdcb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:07.006006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8f00c-45e4-44ee-a9f3-bc3688e6bdcb None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:07.007399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 750/1503] 10.222.0.49 () {54 vars in 963 bytes} [Tue Jun 28 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:10:07.012130 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8310db-4953-4d68-9365-211c109dbab9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:07.012425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8310db-4953-4d68-9365-211c109dbab9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:07.012709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8310db-4953-4d68-9365-211c109dbab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:07.030134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fa8310db-4953-4d68-9365-211c109dbab9 None None] MFA Rules not processed for user `62bbcb039ed44749ab80bfc97dabd7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:10:07.031342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa8310db-4953-4d68-9365-211c109dbab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:10:07.077222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:07.084253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 754/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Tue Jun 28 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:10:07.091840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8f00c-45e4-44ee-a9f3-bc3688e6bdcb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:07.103103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8f00c-45e4-44ee-a9f3-bc3688e6bdcb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:07.106651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23939291-9c88-42c3-9be9-ccec9776e6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:07.107281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939291-9c88-42c3-9be9-ccec9776e6da service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:07.107565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939291-9c88-42c3-9be9-ccec9776e6da service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:07.107839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939291-9c88-42c3-9be9-ccec9776e6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:07.116637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23939291-9c88-42c3-9be9-ccec9776e6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:07.118063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23939291-9c88-42c3-9be9-ccec9776e6da service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:07.126796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 751/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:10:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:10:07.170622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133203f0-819d-4bc0-bdf3-ba11131f2e01 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:07.170991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133203f0-819d-4bc0-bdf3-ba11131f2e01 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:07.171336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133203f0-819d-4bc0-bdf3-ba11131f2e01 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:07.172736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 755/1506] 10.222.0.49 () {52 vars in 829 bytes} [Tue Jun 28 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:10:07.177464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23939291-9c88-42c3-9be9-ccec9776e6da service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:07.238682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23939291-9c88-42c3-9be9-ccec9776e6da service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:07.243156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:07.244072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:07.244357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:07.244634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] PATH_INFO: `/v3/users/7ac777d7c3f5405fb742ce9fc777b73a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:07.245812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac777d7c3f5405fb742ce9fc777b73a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:07.246829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WARNING py.warnings [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:10:07.246829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: warnings.warn(msg) Jun 28 12:10:07.246829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: Jun 28 12:10:07.248066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:07.532586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac777d7c3f5405fb742ce9fc777b73a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:07.544881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac777d7c3f5405fb742ce9fc777b73a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:07.637993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac777d7c3f5405fb742ce9fc777b73a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:07.638729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac777d7c3f5405fb742ce9fc777b73a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:07.657047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:07.660150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac777d7c3f5405fb742ce9fc777b73a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:07.666232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 752/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:10:07 2022] DELETE /identity/v3/users/7ac777d7c3f5405fb742ce9fc777b73a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:10:07.670962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893ce50-ddc7-4d82-b4a9-7eed535e05f1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:07.671427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893ce50-ddc7-4d82-b4a9-7eed535e05f1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:07.671427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893ce50-ddc7-4d82-b4a9-7eed535e05f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:07.690174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b893ce50-ddc7-4d82-b4a9-7eed535e05f1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:10:07.691383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b893ce50-ddc7-4d82-b4a9-7eed535e05f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:10:07.748502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 756/1508] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:10:07.758509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:07.760029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:10:07.817305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c9eb9-4c34-46d2-b763-bbd9aa8c95ab admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:07.820926 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ba763-e096-4edc-ace2-a7b9f40c7f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:07.821677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ba763-e096-4edc-ace2-a7b9f40c7f9e service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:07.821970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ba763-e096-4edc-ace2-a7b9f40c7f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:07.822251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ba763-e096-4edc-ace2-a7b9f40c7f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:07.831857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ba763-e096-4edc-ace2-a7b9f40c7f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:07.833316 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ba763-e096-4edc-ace2-a7b9f40c7f9e service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:07.842694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 753/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:10:08.314923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893ce50-ddc7-4d82-b4a9-7eed535e05f1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:10:08.316614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b893ce50-ddc7-4d82-b4a9-7eed535e05f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:10:08.328779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893ce50-ddc7-4d82-b4a9-7eed535e05f1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:10:08.334684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:10:08.335598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:10:08.335900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:10:08.336190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] PATH_INFO: `/v3/projects/da3a8cce3f3b4c9298100dba4aab4dce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:10:08.337379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3a8cce3f3b4c9298100dba4aab4dce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:10:08.339006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:10:08.339006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 28 12:10:08.339006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: Jun 28 12:10:08.340287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:10:08.472777 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3a8cce3f3b4c9298100dba4aab4dce', 'request_id': 'req-a0584dd1-94b6-4c5b-b696-cfd11273d746'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:08.540156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3a8cce3f3b4c9298100dba4aab4dce', 'request_id': 'req-a0584dd1-94b6-4c5b-b696-cfd11273d746'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:08.554071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3a8cce3f3b4c9298100dba4aab4dce', 'request_id': 'req-a0584dd1-94b6-4c5b-b696-cfd11273d746'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:08.565650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] The token cache is being invalidate because project da3a8cce3f3b4c9298100dba4aab4dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:10:08.565876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:08.566529 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0584dd1-94b6-4c5b-b696-cfd11273d746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:10:08.568252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 757/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:10:08 2022] DELETE /identity/v3/projects/da3a8cce3f3b4c9298100dba4aab4dce => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:10:17.838522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:10:18.561714 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:11:51.871564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866fb66-1378-4c8f-9d1f-1888a07d1516 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:51.872174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866fb66-1378-4c8f-9d1f-1888a07d1516 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:51.872174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866fb66-1378-4c8f-9d1f-1888a07d1516 None None] PATH_INFO: `/v3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:51.873440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 754/1511] 10.222.0.58 () {54 vars in 925 bytes} [Tue Jun 28 12:11:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:11:51.880774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c922f40-ce19-4d36-bddd-df0a94094d56 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:51.881207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c922f40-ce19-4d36-bddd-df0a94094d56 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:51.881358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c922f40-ce19-4d36-bddd-df0a94094d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:51.899734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2c922f40-ce19-4d36-bddd-df0a94094d56 None None] MFA Rules not processed for user `c7db581dec064fe0afeb4be5838470bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:11:51.900973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c922f40-ce19-4d36-bddd-df0a94094d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:11:51.969226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 758/1512] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Jun 28 12:11:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:11:53.627070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa335175-f342-49f6-91fb-5b893f177325 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:53.627609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa335175-f342-49f6-91fb-5b893f177325 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:53.627609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa335175-f342-49f6-91fb-5b893f177325 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:53.629036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 755/1513] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:11:53.633957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197ed10-93e7-4607-aff3-88482e661835 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:53.634378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197ed10-93e7-4607-aff3-88482e661835 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:53.634518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197ed10-93e7-4607-aff3-88482e661835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:53.652743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3197ed10-93e7-4607-aff3-88482e661835 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:11:53.653958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3197ed10-93e7-4607-aff3-88482e661835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:11:53.712557 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 759/1514] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:11:53.867831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa335175-f342-49f6-91fb-5b893f177325 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:11:53.869535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aa335175-f342-49f6-91fb-5b893f177325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:11:53.942647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa335175-f342-49f6-91fb-5b893f177325 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:11:53.948283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05719c9-6c37-44c6-a6f5-5f4df215eb42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:11:53.948924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05719c9-6c37-44c6-a6f5-5f4df215eb42 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:53.949204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05719c9-6c37-44c6-a6f5-5f4df215eb42 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:53.949478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05719c9-6c37-44c6-a6f5-5f4df215eb42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:53.958349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05719c9-6c37-44c6-a6f5-5f4df215eb42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:11:53.960329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05719c9-6c37-44c6-a6f5-5f4df215eb42 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:11:53.970156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 756/1515] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:11:54.801611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e6a5-410f-4730-821d-1f2c2e057475 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:54.802162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e6a5-410f-4730-821d-1f2c2e057475 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:54.802162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e6a5-410f-4730-821d-1f2c2e057475 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:54.803524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 760/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:11:54.808652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f76c-a1a1-4adb-8044-ba78983620ca None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:54.809053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f76c-a1a1-4adb-8044-ba78983620ca None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:54.809326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f76c-a1a1-4adb-8044-ba78983620ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:54.828100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-40c9f76c-a1a1-4adb-8044-ba78983620ca None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:11:54.829285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-40c9f76c-a1a1-4adb-8044-ba78983620ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:11:54.836998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 757/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:11:54.990426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357e6a5-410f-4730-821d-1f2c2e057475 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:11:55.005212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357e6a5-410f-4730-821d-1f2c2e057475 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:11:55.010539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1beda-bac3-4e0c-8fec-fbeb7bf738f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:11:55.011175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1beda-bac3-4e0c-8fec-fbeb7bf738f4 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:55.011459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1beda-bac3-4e0c-8fec-fbeb7bf738f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:55.011736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1beda-bac3-4e0c-8fec-fbeb7bf738f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:55.019863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1beda-bac3-4e0c-8fec-fbeb7bf738f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:11:55.021489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1beda-bac3-4e0c-8fec-fbeb7bf738f4 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:11:55.031526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 761/1518] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:11:59.051369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f577a8-a373-4321-acd3-0a6582e4dd52 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:59.051910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f577a8-a373-4321-acd3-0a6582e4dd52 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:59.052041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f577a8-a373-4321-acd3-0a6582e4dd52 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:59.053395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 758/1519] 10.222.0.49 () {54 vars in 960 bytes} [Tue Jun 28 12:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:11:59.058217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5a274-6333-4197-a93b-cd26a06f8595 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:59.058621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5a274-6333-4197-a93b-cd26a06f8595 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:59.058773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5a274-6333-4197-a93b-cd26a06f8595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:59.079598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a8f5a274-6333-4197-a93b-cd26a06f8595 None None] MFA Rules not processed for user `c7db581dec064fe0afeb4be5838470bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:11:59.080844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a8f5a274-6333-4197-a93b-cd26a06f8595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:11:59.089300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 762/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Tue Jun 28 12:11:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:11:59.096763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f577a8-a373-4321-acd3-0a6582e4dd52 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:11:59.110261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f577a8-a373-4321-acd3-0a6582e4dd52 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:11:59.115070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3b6f1-b28b-40a1-b361-2ea74f8271a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:11:59.115693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3b6f1-b28b-40a1-b361-2ea74f8271a0 service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:11:59.116015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3b6f1-b28b-40a1-b361-2ea74f8271a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:11:59.116299 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3b6f1-b28b-40a1-b361-2ea74f8271a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:11:59.124480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3b6f1-b28b-40a1-b361-2ea74f8271a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:11:59.126684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3b6f1-b28b-40a1-b361-2ea74f8271a0 service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:11:59.136219 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 759/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:11:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:12:06.262993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc7fb-f69c-4ba5-91fa-94f6e3e0272a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:06.263520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc7fb-f69c-4ba5-91fa-94f6e3e0272a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:06.263520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc7fb-f69c-4ba5-91fa-94f6e3e0272a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:06.264951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:12:06.269838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516f5c6-ac8b-4aa9-b1f4-b9d1c1794408 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:06.270269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516f5c6-ac8b-4aa9-b1f4-b9d1c1794408 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:06.270399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516f5c6-ac8b-4aa9-b1f4-b9d1c1794408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:06.288798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c516f5c6-ac8b-4aa9-b1f4-b9d1c1794408 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:12:06.289977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c516f5c6-ac8b-4aa9-b1f4-b9d1c1794408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:06.298485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:12:06.451633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc7fb-f69c-4ba5-91fa-94f6e3e0272a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:12:06.465952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc7fb-f69c-4ba5-91fa-94f6e3e0272a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:12:06.472225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc27e-71a9-4c33-9183-302c306bf1a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:12:06.472877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc27e-71a9-4c33-9183-302c306bf1a3 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:06.473206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc27e-71a9-4c33-9183-302c306bf1a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:06.473436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc27e-71a9-4c33-9183-302c306bf1a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:06.481694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc27e-71a9-4c33-9183-302c306bf1a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:12:06.483276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc27e-71a9-4c33-9183-302c306bf1a3 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:12:06.493641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 764/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:12:07.324086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf303b3-3abf-4c52-adf7-1738fd1ab17b None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:07.324657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf303b3-3abf-4c52-adf7-1738fd1ab17b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:07.324657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf303b3-3abf-4c52-adf7-1738fd1ab17b None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:07.326049 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 12:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:12:07.331718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7033b4-ca7d-4595-9787-8c36b3ef9fcb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:07.332186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7033b4-ca7d-4595-9787-8c36b3ef9fcb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:07.332290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7033b4-ca7d-4595-9787-8c36b3ef9fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:07.353021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ab7033b4-ca7d-4595-9787-8c36b3ef9fcb None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:12:07.354223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab7033b4-ca7d-4595-9787-8c36b3ef9fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:07.362600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 12:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:12:07.517377 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf303b3-3abf-4c52-adf7-1738fd1ab17b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:12:07.531741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf303b3-3abf-4c52-adf7-1738fd1ab17b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:12:07.537085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc06483-2c70-4538-8406-c96f25bff89e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:12:07.537719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc06483-2c70-4538-8406-c96f25bff89e service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:07.538014 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc06483-2c70-4538-8406-c96f25bff89e service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:07.538274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc06483-2c70-4538-8406-c96f25bff89e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:07.546847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc06483-2c70-4538-8406-c96f25bff89e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:12:07.548568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc06483-2c70-4538-8406-c96f25bff89e service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:12:07.557931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 762/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:12:11.882574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a9b58-f91f-4da9-958c-0817c42c3861 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:11.883184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a9b58-f91f-4da9-958c-0817c42c3861 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:11.883184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a9b58-f91f-4da9-958c-0817c42c3861 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:11.884538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:12:11.890531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512110e4-d9e6-4e0a-bb8c-0ec84d1aaddd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:11.890982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512110e4-d9e6-4e0a-bb8c-0ec84d1aaddd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:11.891243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512110e4-d9e6-4e0a-bb8c-0ec84d1aaddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:11.909741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-512110e4-d9e6-4e0a-bb8c-0ec84d1aaddd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:12:11.910957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-512110e4-d9e6-4e0a-bb8c-0ec84d1aaddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:11.918745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:12:11.955464 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a9b58-f91f-4da9-958c-0817c42c3861 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:12:11.957347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b72a9b58-f91f-4da9-958c-0817c42c3861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:12.012774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a9b58-f91f-4da9-958c-0817c42c3861 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:12:12.016984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91596ee3-2246-4d39-836a-e95e2bf3fce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:12:12.017617 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596ee3-2246-4d39-836a-e95e2bf3fce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:12.017898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596ee3-2246-4d39-836a-e95e2bf3fce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:12.018174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596ee3-2246-4d39-836a-e95e2bf3fce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:12.026838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91596ee3-2246-4d39-836a-e95e2bf3fce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:12:12.028294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91596ee3-2246-4d39-836a-e95e2bf3fce2 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:12:12.033766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:12.038317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 767/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:12:14.059003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347f748-4b10-4422-af6e-fc4dd31e4853 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:14.059565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347f748-4b10-4422-af6e-fc4dd31e4853 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:14.059565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347f748-4b10-4422-af6e-fc4dd31e4853 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:14.060958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:12:14.066431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76078137-303d-4a57-bea2-4fcbcf38eacc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:14.066907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76078137-303d-4a57-bea2-4fcbcf38eacc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:14.067015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76078137-303d-4a57-bea2-4fcbcf38eacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:14.085955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-76078137-303d-4a57-bea2-4fcbcf38eacc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:12:14.087154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76078137-303d-4a57-bea2-4fcbcf38eacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:14.095644 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:12:14.131565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347f748-4b10-4422-af6e-fc4dd31e4853 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:12:14.133524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7347f748-4b10-4422-af6e-fc4dd31e4853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:14.147441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347f748-4b10-4422-af6e-fc4dd31e4853 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:12:14.151170 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967a888-d034-4f7c-b3a3-2f1a4163b34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:12:14.151810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967a888-d034-4f7c-b3a3-2f1a4163b34b service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:14.152230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967a888-d034-4f7c-b3a3-2f1a4163b34b service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:14.152510 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967a888-d034-4f7c-b3a3-2f1a4163b34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:14.162640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967a888-d034-4f7c-b3a3-2f1a4163b34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:12:14.164108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967a888-d034-4f7c-b3a3-2f1a4163b34b service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:12:14.173641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 765/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:12:17.845942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11dc2d-c335-4910-85de-a7aeedfd9ecb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:17.846471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11dc2d-c335-4910-85de-a7aeedfd9ecb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:17.846471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11dc2d-c335-4910-85de-a7aeedfd9ecb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:17.847857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:12:17.852930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38043-c4bf-4d0c-bde8-5dd5ab7fb33b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:17.853399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38043-c4bf-4d0c-bde8-5dd5ab7fb33b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:17.853494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38043-c4bf-4d0c-bde8-5dd5ab7fb33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:17.871542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7dc38043-c4bf-4d0c-bde8-5dd5ab7fb33b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:12:17.872751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7dc38043-c4bf-4d0c-bde8-5dd5ab7fb33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:17.880688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:12:18.198163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11dc2d-c335-4910-85de-a7aeedfd9ecb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:12:18.199903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f11dc2d-c335-4910-85de-a7aeedfd9ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:18.257742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11dc2d-c335-4910-85de-a7aeedfd9ecb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:12:18.261325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11635e60-dcd9-48cb-bd6a-69639f1678c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:12:18.261967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11635e60-dcd9-48cb-bd6a-69639f1678c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:18.262259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11635e60-dcd9-48cb-bd6a-69639f1678c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:18.262539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11635e60-dcd9-48cb-bd6a-69639f1678c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:18.272118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11635e60-dcd9-48cb-bd6a-69639f1678c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:12:18.273544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11635e60-dcd9-48cb-bd6a-69639f1678c6 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:12:18.282963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 770/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:12:20.341361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e50477-f662-40e7-9b7d-8d822d9bc6cf None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:20.341905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e50477-f662-40e7-9b7d-8d822d9bc6cf None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:20.341905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e50477-f662-40e7-9b7d-8d822d9bc6cf None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:20.344047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 12:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:12:20.349265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b471-64ae-4bb5-8f8c-f7ddfd0a1369 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:20.349696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b471-64ae-4bb5-8f8c-f7ddfd0a1369 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:20.349845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b471-64ae-4bb5-8f8c-f7ddfd0a1369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:20.368034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-edd0b471-64ae-4bb5-8f8c-f7ddfd0a1369 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:12:20.369358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-edd0b471-64ae-4bb5-8f8c-f7ddfd0a1369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:20.377850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 12:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:12:20.681475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e50477-f662-40e7-9b7d-8d822d9bc6cf None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:12:20.683179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-72e50477-f662-40e7-9b7d-8d822d9bc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:12:20.691390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=65 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:20.697536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e50477-f662-40e7-9b7d-8d822d9bc6cf None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:12:20.701095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d8c3b-6338-4e9c-9ecc-fca39cde5bce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:12:20.707071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8c3b-6338-4e9c-9ecc-fca39cde5bce service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:12:20.707071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8c3b-6338-4e9c-9ecc-fca39cde5bce service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:12:20.707071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8c3b-6338-4e9c-9ecc-fca39cde5bce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:12:20.712005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d8c3b-6338-4e9c-9ecc-fca39cde5bce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:12:20.713426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d8c3b-6338-4e9c-9ecc-fca39cde5bce service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:12:20.723177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 768/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:12:30.362875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=32 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:12:30.725536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:57.471598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1322-7f83-4430-9760-476d1d73837d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:57.506330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1322-7f83-4430-9760-476d1d73837d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:57.506330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1322-7f83-4430-9760-476d1d73837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:57.506330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bdfb1322-7f83-4430-9760-476d1d73837d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:57.506330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bdfb1322-7f83-4430-9760-476d1d73837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:57.510818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 772/1540] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:13:57.520405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa7f42-0135-4a0c-a2a6-7359f7be355e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:57.524948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa7f42-0135-4a0c-a2a6-7359f7be355e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:57.524948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa7f42-0135-4a0c-a2a6-7359f7be355e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:57.552146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bcfa7f42-0135-4a0c-a2a6-7359f7be355e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:57.553679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bcfa7f42-0135-4a0c-a2a6-7359f7be355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:57.568013 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 769/1541] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:57.572373 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1322-7f83-4430-9760-476d1d73837d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:57.585530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1322-7f83-4430-9760-476d1d73837d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:57.595306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336a139-1c10-4037-86fe-46e6e1106776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:57.596028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336a139-1c10-4037-86fe-46e6e1106776 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:57.596318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336a139-1c10-4037-86fe-46e6e1106776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:57.596599 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336a139-1c10-4037-86fe-46e6e1106776 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:57.597482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336a139-1c10-4037-86fe-46e6e1106776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:13:57.598575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336a139-1c10-4037-86fe-46e6e1106776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:57.599441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336a139-1c10-4037-86fe-46e6e1106776 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:57.617645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 773/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:13:57.628105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa7f42-0135-4a0c-a2a6-7359f7be355e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:57.642892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa7f42-0135-4a0c-a2a6-7359f7be355e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:57.651785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57790b0a-ff57-4240-99dc-c116a1be2823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:57.652839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790b0a-ff57-4240-99dc-c116a1be2823 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:57.653354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790b0a-ff57-4240-99dc-c116a1be2823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:57.653948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790b0a-ff57-4240-99dc-c116a1be2823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:57.655053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57790b0a-ff57-4240-99dc-c116a1be2823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:57.657371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57790b0a-ff57-4240-99dc-c116a1be2823 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:57.755635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 770/1543] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:13:57 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:57.760308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336a139-1c10-4037-86fe-46e6e1106776 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:57.778663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336a139-1c10-4037-86fe-46e6e1106776 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:57.783404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80f12-31dd-4d01-a70f-8f90c2d35348 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:57.788045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80f12-31dd-4d01-a70f-8f90c2d35348 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:57.788045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80f12-31dd-4d01-a70f-8f90c2d35348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:57.817988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f4b80f12-31dd-4d01-a70f-8f90c2d35348 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:57.819503 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f4b80f12-31dd-4d01-a70f-8f90c2d35348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:57.871765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428374ff-7616-410e-91f3-a3faa13850f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:57.873067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428374ff-7616-410e-91f3-a3faa13850f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:57.873366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428374ff-7616-410e-91f3-a3faa13850f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:57.873970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428374ff-7616-410e-91f3-a3faa13850f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:57.874784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428374ff-7616-410e-91f3-a3faa13850f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:57.876692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428374ff-7616-410e-91f3-a3faa13850f1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:57.945540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 771/1544] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:57.957634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a377b84-8327-41e2-8439-f19e6b9e2f11 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:57.958250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a377b84-8327-41e2-8439-f19e6b9e2f11 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:57.958728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a377b84-8327-41e2-8439-f19e6b9e2f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:57.977085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 774/1545] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:13:57 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:57.978182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd3aa-e29f-4c78-a8d7-035f083b28c1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:57.978477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd3aa-e29f-4c78-a8d7-035f083b28c1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:57.978761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd3aa-e29f-4c78-a8d7-035f083b28c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:57.992909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1a377b84-8327-41e2-8439-f19e6b9e2f11 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:57.994459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1a377b84-8327-41e2-8439-f19e6b9e2f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.015097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-668cd3aa-e29f-4c78-a8d7-035f083b28c1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.016498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-668cd3aa-e29f-4c78-a8d7-035f083b28c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.017844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 772/1546] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:13:58.019174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a377b84-8327-41e2-8439-f19e6b9e2f11 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.028502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 775/1547] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.034922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd3aa-e29f-4c78-a8d7-035f083b28c1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.039239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a377b84-8327-41e2-8439-f19e6b9e2f11 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.047002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd3aa-e29f-4c78-a8d7-035f083b28c1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.052764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1b3f3-4f0b-4928-8aea-7f80e53e13ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.053398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4a53-304c-47fe-9d72-d4eae8a75cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.053541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1b3f3-4f0b-4928-8aea-7f80e53e13ea admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.053756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1b3f3-4f0b-4928-8aea-7f80e53e13ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.054043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1b3f3-4f0b-4928-8aea-7f80e53e13ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.054835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4a53-304c-47fe-9d72-d4eae8a75cab admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.055040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1b3f3-4f0b-4928-8aea-7f80e53e13ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:13:58.055362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1b3f3-4f0b-4928-8aea-7f80e53e13ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.055701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4a53-304c-47fe-9d72-d4eae8a75cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.056190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e4a53-304c-47fe-9d72-d4eae8a75cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.057172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e4a53-304c-47fe-9d72-d4eae8a75cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.059861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e4a53-304c-47fe-9d72-d4eae8a75cab admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.062289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1b3f3-4f0b-4928-8aea-7f80e53e13ea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.081792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 776/1548] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:13:58.082365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 773/1549] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:13:58.085968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7a17e-90bf-4739-8cb4-48891b8e84e3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.085968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7a17e-90bf-4739-8cb4-48891b8e84e3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.085968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7a17e-90bf-4739-8cb4-48891b8e84e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.093864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4a53-304c-47fe-9d72-d4eae8a75cab admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.113418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-45f7a17e-90bf-4739-8cb4-48891b8e84e3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.114639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-45f7a17e-90bf-4739-8cb4-48891b8e84e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.116069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e4a53-304c-47fe-9d72-d4eae8a75cab admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.127575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 777/1550] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.130451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7a17e-90bf-4739-8cb4-48891b8e84e3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.133579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929dfa9-038f-478e-ba2e-5ccc11e980ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.134684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929dfa9-038f-478e-ba2e-5ccc11e980ec admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.135183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929dfa9-038f-478e-ba2e-5ccc11e980ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.135650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929dfa9-038f-478e-ba2e-5ccc11e980ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.136639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929dfa9-038f-478e-ba2e-5ccc11e980ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.139757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929dfa9-038f-478e-ba2e-5ccc11e980ec admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.155484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7a17e-90bf-4739-8cb4-48891b8e84e3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.161564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 774/1551] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:13:58.166561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236e08c-9146-40af-ad1c-f12118580de0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.168850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236e08c-9146-40af-ad1c-f12118580de0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.169676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236e08c-9146-40af-ad1c-f12118580de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.171246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964e2dd-76d5-42e0-b5f1-deb951d433e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.173562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964e2dd-76d5-42e0-b5f1-deb951d433e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.174056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964e2dd-76d5-42e0-b5f1-deb951d433e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.174530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964e2dd-76d5-42e0-b5f1-deb951d433e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.175788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964e2dd-76d5-42e0-b5f1-deb951d433e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.177528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-4964e2dd-76d5-42e0-b5f1-deb951d433e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:13:58.177528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 28 12:13:58.177528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: Jun 28 12:13:58.179848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964e2dd-76d5-42e0-b5f1-deb951d433e8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.208669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d236e08c-9146-40af-ad1c-f12118580de0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.209874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d236e08c-9146-40af-ad1c-f12118580de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.218338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 775/1552] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.219253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236e08c-9146-40af-ad1c-f12118580de0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.229317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236e08c-9146-40af-ad1c-f12118580de0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.234493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040c75c-876f-4105-8cfb-10f9a9462f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.235141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040c75c-876f-4105-8cfb-10f9a9462f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.235422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040c75c-876f-4105-8cfb-10f9a9462f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.235697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040c75c-876f-4105-8cfb-10f9a9462f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.236682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040c75c-876f-4105-8cfb-10f9a9462f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:13:58.236795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040c75c-876f-4105-8cfb-10f9a9462f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.238129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WARNING py.warnings [None req-1040c75c-876f-4105-8cfb-10f9a9462f8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:13:58.238129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: warnings.warn(msg) Jun 28 12:13:58.238129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: Jun 28 12:13:58.239013 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040c75c-876f-4105-8cfb-10f9a9462f8e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.252153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 776/1553] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:13:58.254072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf42498-2d3a-4c99-b882-a0917e445027 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.254072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf42498-2d3a-4c99-b882-a0917e445027 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.254251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf42498-2d3a-4c99-b882-a0917e445027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.277016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-abf42498-2d3a-4c99-b882-a0917e445027 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.277016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-abf42498-2d3a-4c99-b882-a0917e445027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.281213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 778/1554] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:58.282029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964e2dd-76d5-42e0-b5f1-deb951d433e8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.284793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 777/1555] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.286279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f3f44-a1c9-43aa-ad13-d77725881bcc None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.286574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f3f44-a1c9-43aa-ad13-d77725881bcc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.286854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f3f44-a1c9-43aa-ad13-d77725881bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.306634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7f9f3f44-a1c9-43aa-ad13-d77725881bcc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.307816 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7f9f3f44-a1c9-43aa-ad13-d77725881bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.348115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964e2dd-76d5-42e0-b5f1-deb951d433e8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.352818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a61c0-409d-4e00-9212-143f617e82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.353713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a61c0-409d-4e00-9212-143f617e82f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.353998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a61c0-409d-4e00-9212-143f617e82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.354306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a61c0-409d-4e00-9212-143f617e82f1 admin admin] PATH_INFO: `/v3/projects/d50e7a75909d4b1fa632974320bdf4db/users/6cebe6f32ada4875b7777d90ef52b677/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.368745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a61c0-409d-4e00-9212-143f617e82f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50e7a75909d4b1fa632974320bdf4db, user_id=6cebe6f32ada4875b7777d90ef52b677, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.369773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-535a61c0-409d-4e00-9212-143f617e82f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:13:58.369773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 28 12:13:58.369773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: Jun 28 12:13:58.370627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 778/1556] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.376074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a61c0-409d-4e00-9212-143f617e82f1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.376191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed309-a141-4f74-b831-d3f6eeed1b51 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.376191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed309-a141-4f74-b831-d3f6eeed1b51 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.376191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed309-a141-4f74-b831-d3f6eeed1b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.391237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e77ed309-a141-4f74-b831-d3f6eeed1b51 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.392501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e77ed309-a141-4f74-b831-d3f6eeed1b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.400399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 779/1557] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.401593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed890f-6d92-49e6-ad97-98cbe155337f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.401882 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed890f-6d92-49e6-ad97-98cbe155337f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.402162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed890f-6d92-49e6-ad97-98cbe155337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.419762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-28ed890f-6d92-49e6-ad97-98cbe155337f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.420984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-28ed890f-6d92-49e6-ad97-98cbe155337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.426424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:58.427069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 779/1558] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:13:58 2022] PUT /identity/v3/projects/d50e7a75909d4b1fa632974320bdf4db/users/6cebe6f32ada4875b7777d90ef52b677/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:13:58.431680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a61c0-409d-4e00-9212-143f617e82f1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.433343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:58.481611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 780/1559] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.483151 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d288-3fdc-44bd-bf03-d6cd8117551f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.483484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d288-3fdc-44bd-bf03-d6cd8117551f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.483759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d288-3fdc-44bd-bf03-d6cd8117551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.491606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a61c0-409d-4e00-9212-143f617e82f1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.496183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d36f9-89c5-4785-82e2-805c676cc4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.508564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d36f9-89c5-4785-82e2-805c676cc4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.508564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d36f9-89c5-4785-82e2-805c676cc4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.508564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d36f9-89c5-4785-82e2-805c676cc4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.508564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d36f9-89c5-4785-82e2-805c676cc4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.508564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d36f9-89c5-4785-82e2-805c676cc4b3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.508967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0211d288-3fdc-44bd-bf03-d6cd8117551f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.508967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0211d288-3fdc-44bd-bf03-d6cd8117551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.514186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 781/1560] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.515566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211d288-3fdc-44bd-bf03-d6cd8117551f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.532827 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211d288-3fdc-44bd-bf03-d6cd8117551f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.537548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50aa7d-59ff-453a-b841-b23c527dd524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.538200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50aa7d-59ff-453a-b841-b23c527dd524 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.538483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50aa7d-59ff-453a-b841-b23c527dd524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.538760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50aa7d-59ff-453a-b841-b23c527dd524 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.539453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50aa7d-59ff-453a-b841-b23c527dd524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.540508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WARNING py.warnings [None req-da50aa7d-59ff-453a-b841-b23c527dd524 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:13:58.540508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: warnings.warn(msg) Jun 28 12:13:58.540508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: Jun 28 12:13:58.541704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50aa7d-59ff-453a-b841-b23c527dd524 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.578300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 780/1561] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/projects => generated 391 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:58.579661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c657031-ec3f-4a36-bf69-bec37f654ba1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.579968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c657031-ec3f-4a36-bf69-bec37f654ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.580252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c657031-ec3f-4a36-bf69-bec37f654ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.600187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1c657031-ec3f-4a36-bf69-bec37f654ba1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.601403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1c657031-ec3f-4a36-bf69-bec37f654ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.616071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 782/1562] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:58.617359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ac15-1420-467b-a6d1-be6a55f0ea0f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.617653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ac15-1420-467b-a6d1-be6a55f0ea0f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.617975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ac15-1420-467b-a6d1-be6a55f0ea0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.636164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1900ac15-1420-467b-a6d1-be6a55f0ea0f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.637366 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1900ac15-1420-467b-a6d1-be6a55f0ea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.665569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 781/1563] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.667002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c369c-cc4d-49e6-a2c8-286ab64f13f5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.667293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c369c-cc4d-49e6-a2c8-286ab64f13f5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.667579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c369c-cc4d-49e6-a2c8-286ab64f13f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.685497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-494c369c-cc4d-49e6-a2c8-286ab64f13f5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.686807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-494c369c-cc4d-49e6-a2c8-286ab64f13f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.695080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 782/1564] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.696671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624ac94-7844-44e0-9483-09ab452edd76 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.696983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624ac94-7844-44e0-9483-09ab452edd76 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.697274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624ac94-7844-44e0-9483-09ab452edd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.706485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 783/1565] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.708830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ac15-1420-467b-a6d1-be6a55f0ea0f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.715115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d624ac94-7844-44e0-9483-09ab452edd76 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.716377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d624ac94-7844-44e0-9483-09ab452edd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.719243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ac15-1420-467b-a6d1-be6a55f0ea0f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.723742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4f5ba-274f-44ea-92ec-32c06a8189e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.724155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 783/1566] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.724423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4f5ba-274f-44ea-92ec-32c06a8189e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.724705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4f5ba-274f-44ea-92ec-32c06a8189e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.724975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4f5ba-274f-44ea-92ec-32c06a8189e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.725414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363d709-c187-4043-bdd7-6bf4e017aabc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.725710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4f5ba-274f-44ea-92ec-32c06a8189e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:13:58.725808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363d709-c187-4043-bdd7-6bf4e017aabc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.725976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363d709-c187-4043-bdd7-6bf4e017aabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.726059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4f5ba-274f-44ea-92ec-32c06a8189e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.727605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4f5ba-274f-44ea-92ec-32c06a8189e8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.739775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 784/1567] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:13:58.740598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4f5ba-274f-44ea-92ec-32c06a8189e8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.750721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4f5ba-274f-44ea-92ec-32c06a8189e8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.753370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5363d709-c187-4043-bdd7-6bf4e017aabc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:58.754580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5363d709-c187-4043-bdd7-6bf4e017aabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:58.755253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f93b4-296f-44d0-80a8-2e715d6a6739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.755925 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f93b4-296f-44d0-80a8-2e715d6a6739 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.756209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f93b4-296f-44d0-80a8-2e715d6a6739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.756493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f93b4-296f-44d0-80a8-2e715d6a6739 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.757158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f93b4-296f-44d0-80a8-2e715d6a6739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.759070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f93b4-296f-44d0-80a8-2e715d6a6739 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.762609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 784/1568] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:58.764247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363d709-c187-4043-bdd7-6bf4e017aabc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.774021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363d709-c187-4043-bdd7-6bf4e017aabc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.778568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce72a7-ec29-406b-bafb-249909532d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.779217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce72a7-ec29-406b-bafb-249909532d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.779498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce72a7-ec29-406b-bafb-249909532d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.779781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce72a7-ec29-406b-bafb-249909532d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.780547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce72a7-ec29-406b-bafb-249909532d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.782112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce72a7-ec29-406b-bafb-249909532d68 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.792134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 785/1569] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:13:58.792841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce72a7-ec29-406b-bafb-249909532d68 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.802609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce72a7-ec29-406b-bafb-249909532d68 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.807109 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cf2f9-1565-4cfa-95da-8b1adf38baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.815007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cf2f9-1565-4cfa-95da-8b1adf38baf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.815007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cf2f9-1565-4cfa-95da-8b1adf38baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.815007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cf2f9-1565-4cfa-95da-8b1adf38baf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.815007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cf2f9-1565-4cfa-95da-8b1adf38baf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:13:58.815007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cf2f9-1565-4cfa-95da-8b1adf38baf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.815007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cf2f9-1565-4cfa-95da-8b1adf38baf5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.823089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 786/1570] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:13:58.823832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cf2f9-1565-4cfa-95da-8b1adf38baf5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.833578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cf2f9-1565-4cfa-95da-8b1adf38baf5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.838165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04be15-d2fc-4453-81a3-f3c19b3deca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.838787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04be15-d2fc-4453-81a3-f3c19b3deca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.839068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04be15-d2fc-4453-81a3-f3c19b3deca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.839343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04be15-d2fc-4453-81a3-f3c19b3deca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.840082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04be15-d2fc-4453-81a3-f3c19b3deca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:13:58.840390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04be15-d2fc-4453-81a3-f3c19b3deca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.841974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04be15-d2fc-4453-81a3-f3c19b3deca5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.847426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 785/1571] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:58.847426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f93b4-296f-44d0-80a8-2e715d6a6739 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.854369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f93b4-296f-44d0-80a8-2e715d6a6739 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.856598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 787/1572] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:13:58.857837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04be15-d2fc-4453-81a3-f3c19b3deca5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.859554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec8bc-6e1c-4aea-ba2d-6c7842da8ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.860264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec8bc-6e1c-4aea-ba2d-6c7842da8ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.860546 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec8bc-6e1c-4aea-ba2d-6c7842da8ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.860820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ec8bc-6e1c-4aea-ba2d-6c7842da8ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.861585 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ec8bc-6e1c-4aea-ba2d-6c7842da8ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:13:58.861892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ec8bc-6e1c-4aea-ba2d-6c7842da8ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.863525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ec8bc-6e1c-4aea-ba2d-6c7842da8ab7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.877726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 786/1573] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:13:58.877726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec8bc-6e1c-4aea-ba2d-6c7842da8ab7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.886975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ec8bc-6e1c-4aea-ba2d-6c7842da8ab7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.892818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e74dc-e9cb-46c1-85ee-8979c89c67ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.893468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e74dc-e9cb-46c1-85ee-8979c89c67ad admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.893808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e74dc-e9cb-46c1-85ee-8979c89c67ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.894084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e74dc-e9cb-46c1-85ee-8979c89c67ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.894764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e74dc-e9cb-46c1-85ee-8979c89c67ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.896162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:58.896692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e74dc-e9cb-46c1-85ee-8979c89c67ad admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.917015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04be15-d2fc-4453-81a3-f3c19b3deca5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.920674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292cb8e-142e-4df9-80da-8b596c2443c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.921322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292cb8e-142e-4df9-80da-8b596c2443c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.921608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292cb8e-142e-4df9-80da-8b596c2443c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.922074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292cb8e-142e-4df9-80da-8b596c2443c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.931630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292cb8e-142e-4df9-80da-8b596c2443c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.933150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292cb8e-142e-4df9-80da-8b596c2443c0 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.943121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 788/1574] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:13:58.944016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292cb8e-142e-4df9-80da-8b596c2443c0 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.953710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292cb8e-142e-4df9-80da-8b596c2443c0 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:58.958314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed01b3-019e-4a58-910e-6fd0d439edf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:58.958962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed01b3-019e-4a58-910e-6fd0d439edf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:58.959694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed01b3-019e-4a58-910e-6fd0d439edf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:58.959694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed01b3-019e-4a58-910e-6fd0d439edf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:58.960396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed01b3-019e-4a58-910e-6fd0d439edf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:13:58.960705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed01b3-019e-4a58-910e-6fd0d439edf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:58.962305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed01b3-019e-4a58-910e-6fd0d439edf6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:58.979565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 789/1575] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:13:58.979565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed01b3-019e-4a58-910e-6fd0d439edf6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.983225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 787/1576] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:58.984155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e74dc-e9cb-46c1-85ee-8979c89c67ad admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:58.990077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed01b3-019e-4a58-910e-6fd0d439edf6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.010668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:59.047298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687270fa-a1d1-4735-8e59-73aa8992e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.048064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687270fa-a1d1-4735-8e59-73aa8992e2de admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.048362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687270fa-a1d1-4735-8e59-73aa8992e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.048549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e74dc-e9cb-46c1-85ee-8979c89c67ad admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.048668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687270fa-a1d1-4735-8e59-73aa8992e2de admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.049363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687270fa-a1d1-4735-8e59-73aa8992e2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.050961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687270fa-a1d1-4735-8e59-73aa8992e2de admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.054110 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524f3c7-1438-4032-919c-f655589ebed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.054819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524f3c7-1438-4032-919c-f655589ebed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.056083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524f3c7-1438-4032-919c-f655589ebed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.056083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524f3c7-1438-4032-919c-f655589ebed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.056801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524f3c7-1438-4032-919c-f655589ebed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.059086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524f3c7-1438-4032-919c-f655589ebed1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.064106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 790/1577] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:13:59.064962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687270fa-a1d1-4735-8e59-73aa8992e2de admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.075356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687270fa-a1d1-4735-8e59-73aa8992e2de admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.080753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6598a8-31ce-4556-b0e1-770d1a141843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.080990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6598a8-31ce-4556-b0e1-770d1a141843 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.081276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6598a8-31ce-4556-b0e1-770d1a141843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.081558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6598a8-31ce-4556-b0e1-770d1a141843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.082294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6598a8-31ce-4556-b0e1-770d1a141843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.083966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6598a8-31ce-4556-b0e1-770d1a141843 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.094381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 791/1578] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:13:59.095317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6598a8-31ce-4556-b0e1-770d1a141843 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.104985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6598a8-31ce-4556-b0e1-770d1a141843 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.110169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcbb4d-431e-47a5-903e-761579487db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.110810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcbb4d-431e-47a5-903e-761579487db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.111171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcbb4d-431e-47a5-903e-761579487db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.111376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcbb4d-431e-47a5-903e-761579487db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.112117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcbb4d-431e-47a5-903e-761579487db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.114025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcbb4d-431e-47a5-903e-761579487db9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.162781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 788/1579] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:13:58 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:59.162781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524f3c7-1438-4032-919c-f655589ebed1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.203046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 792/1580] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:13:59 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:59.203046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcbb4d-431e-47a5-903e-761579487db9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.223905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524f3c7-1438-4032-919c-f655589ebed1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.283484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcbb4d-431e-47a5-903e-761579487db9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.289754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056323b4-cd7a-4470-bb46-cbac52cc56bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.296299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056323b4-cd7a-4470-bb46-cbac52cc56bf admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.296299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056323b4-cd7a-4470-bb46-cbac52cc56bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.296299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056323b4-cd7a-4470-bb46-cbac52cc56bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.296299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056323b4-cd7a-4470-bb46-cbac52cc56bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.296299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056323b4-cd7a-4470-bb46-cbac52cc56bf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.297469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b18f-43f4-4565-8886-6841e6a01ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.298330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b18f-43f4-4565-8886-6841e6a01ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.298895 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b18f-43f4-4565-8886-6841e6a01ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.299446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b18f-43f4-4565-8886-6841e6a01ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.300824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b18f-43f4-4565-8886-6841e6a01ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.302456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b18f-43f4-4565-8886-6841e6a01ba5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.383263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 793/1581] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:13:59 2022] POST /identity/v3/projects => generated 357 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:59.383949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056323b4-cd7a-4470-bb46-cbac52cc56bf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.396930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:59.408529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 789/1582] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:13:59 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:59.409914 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b18f-43f4-4565-8886-6841e6a01ba5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.448772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056323b4-cd7a-4470-bb46-cbac52cc56bf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.460065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:59.485765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b18f-43f4-4565-8886-6841e6a01ba5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.493016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60504f5-35dd-4cbf-98ac-c3ca5d538612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.493016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60504f5-35dd-4cbf-98ac-c3ca5d538612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.493016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60504f5-35dd-4cbf-98ac-c3ca5d538612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.493016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60504f5-35dd-4cbf-98ac-c3ca5d538612 admin admin] PATH_INFO: `/v3/projects/1bff7879d58c46739abd203f34c921e3/users/4174d5226c454de9bd67dbce1aade939/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.510847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60504f5-35dd-4cbf-98ac-c3ca5d538612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bff7879d58c46739abd203f34c921e3, user_id=4174d5226c454de9bd67dbce1aade939, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.514126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60504f5-35dd-4cbf-98ac-c3ca5d538612 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.516020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa6b89-25ce-4eea-b5c0-b1497d77cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.521189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa6b89-25ce-4eea-b5c0-b1497d77cea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.521189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa6b89-25ce-4eea-b5c0-b1497d77cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.521189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa6b89-25ce-4eea-b5c0-b1497d77cea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.521189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa6b89-25ce-4eea-b5c0-b1497d77cea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.521189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa6b89-25ce-4eea-b5c0-b1497d77cea4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.605605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 790/1583] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:13:59 2022] PUT /identity/v3/projects/1bff7879d58c46739abd203f34c921e3/users/4174d5226c454de9bd67dbce1aade939/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:13:59.606590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60504f5-35dd-4cbf-98ac-c3ca5d538612 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.610110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 794/1584] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:13:59 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:59.611238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa6b89-25ce-4eea-b5c0-b1497d77cea4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.621812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa6b89-25ce-4eea-b5c0-b1497d77cea4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.678612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60504f5-35dd-4cbf-98ac-c3ca5d538612 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.684452 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea25537-d9be-4adf-a23b-589c5644d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.690841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea25537-d9be-4adf-a23b-589c5644d74e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.690841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea25537-d9be-4adf-a23b-589c5644d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.690841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea25537-d9be-4adf-a23b-589c5644d74e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.691163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac1fa7-8c59-4a32-b320-de2993d23595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.691289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea25537-d9be-4adf-a23b-589c5644d74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.691381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac1fa7-8c59-4a32-b320-de2993d23595 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.691381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac1fa7-8c59-4a32-b320-de2993d23595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.691381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac1fa7-8c59-4a32-b320-de2993d23595 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.691624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea25537-d9be-4adf-a23b-589c5644d74e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.691736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac1fa7-8c59-4a32-b320-de2993d23595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.691736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac1fa7-8c59-4a32-b320-de2993d23595 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.699019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 791/1585] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:13:59.699623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea25537-d9be-4adf-a23b-589c5644d74e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.709706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea25537-d9be-4adf-a23b-589c5644d74e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.714345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57046b19-4c6c-4342-aa55-9ee2ad4a06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.715007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57046b19-4c6c-4342-aa55-9ee2ad4a06b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.715294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57046b19-4c6c-4342-aa55-9ee2ad4a06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.715573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57046b19-4c6c-4342-aa55-9ee2ad4a06b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.716941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57046b19-4c6c-4342-aa55-9ee2ad4a06b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.718866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57046b19-4c6c-4342-aa55-9ee2ad4a06b0 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.793527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 795/1586] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:13:59 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:59.795063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac1fa7-8c59-4a32-b320-de2993d23595 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.805822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac1fa7-8c59-4a32-b320-de2993d23595 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.810708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4bda8-0277-44a6-b055-9ae62874b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.811423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4bda8-0277-44a6-b055-9ae62874b593 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.811906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4bda8-0277-44a6-b055-9ae62874b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.812049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4bda8-0277-44a6-b055-9ae62874b593 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.812715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4bda8-0277-44a6-b055-9ae62874b593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.814714 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4bda8-0277-44a6-b055-9ae62874b593 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.818575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 792/1587] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:13:59 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:59.819497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57046b19-4c6c-4342-aa55-9ee2ad4a06b0 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.832619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57046b19-4c6c-4342-aa55-9ee2ad4a06b0 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.837524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b25936-b215-4b20-971f-0283dd687ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.843134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b25936-b215-4b20-971f-0283dd687ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.843134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b25936-b215-4b20-971f-0283dd687ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.843134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b25936-b215-4b20-971f-0283dd687ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.843134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b25936-b215-4b20-971f-0283dd687ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.843134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b25936-b215-4b20-971f-0283dd687ad3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.885516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 796/1588] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:13:59 2022] POST /identity/v3/users => generated 279 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:59.887136 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc58c-c7fd-47dc-bc3d-8e9140e1493a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.887515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc58c-c7fd-47dc-bc3d-8e9140e1493a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.887935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc58c-c7fd-47dc-bc3d-8e9140e1493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.906528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6bcbc58c-c7fd-47dc-bc3d-8e9140e1493a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:13:59.907811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6bcbc58c-c7fd-47dc-bc3d-8e9140e1493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:13:59.915464 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 797/1589] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:13:59.916518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc58c-c7fd-47dc-bc3d-8e9140e1493a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.926438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc58c-c7fd-47dc-bc3d-8e9140e1493a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.931013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5155c14-0619-4f81-9ebc-f70da779001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.932953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5155c14-0619-4f81-9ebc-f70da779001f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.932953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5155c14-0619-4f81-9ebc-f70da779001f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.932953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5155c14-0619-4f81-9ebc-f70da779001f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.932953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5155c14-0619-4f81-9ebc-f70da779001f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.934576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5155c14-0619-4f81-9ebc-f70da779001f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.935606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 793/1590] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:13:59 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:13:59.936762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b25936-b215-4b20-971f-0283dd687ad3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.946592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b25936-b215-4b20-971f-0283dd687ad3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.948434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 798/1591] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:13:59.949248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5155c14-0619-4f81-9ebc-f70da779001f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.952315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b815b-51f5-446e-9450-ac959d43fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.953243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b815b-51f5-446e-9450-ac959d43fc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.953523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b815b-51f5-446e-9450-ac959d43fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.953791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b815b-51f5-446e-9450-ac959d43fc4c admin admin] PATH_INFO: `/v3/projects/5af30325ad8e4d90a334078ff2a94db3/users/cc3cfbaa95774ccbb567374a99e2b25b/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.954916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:13:59.960234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5155c14-0619-4f81-9ebc-f70da779001f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.964933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be6472-8b8e-4fb9-946a-01faab5f1dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.965587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be6472-8b8e-4fb9-946a-01faab5f1dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.965871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be6472-8b8e-4fb9-946a-01faab5f1dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.966288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be6472-8b8e-4fb9-946a-01faab5f1dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.967696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be6472-8b8e-4fb9-946a-01faab5f1dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.969411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be6472-8b8e-4fb9-946a-01faab5f1dfe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.969883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b815b-51f5-446e-9450-ac959d43fc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af30325ad8e4d90a334078ff2a94db3, user_id=cc3cfbaa95774ccbb567374a99e2b25b, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.972691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b815b-51f5-446e-9450-ac959d43fc4c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:13:59.979569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 799/1592] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:13:59.980620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be6472-8b8e-4fb9-946a-01faab5f1dfe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:13:59.990030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be6472-8b8e-4fb9-946a-01faab5f1dfe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:13:59.994620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecf5bd-608d-4b19-b67d-fcc93c950b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:13:59.995243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf5bd-608d-4b19-b67d-fcc93c950b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:13:59.995527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf5bd-608d-4b19-b67d-fcc93c950b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:13:59.995803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf5bd-608d-4b19-b67d-fcc93c950b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:13:59.996538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecf5bd-608d-4b19-b67d-fcc93c950b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:13:59.998121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecf5bd-608d-4b19-b67d-fcc93c950b1d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.007915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 800/1593] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:00.008804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecf5bd-608d-4b19-b67d-fcc93c950b1d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.018679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecf5bd-608d-4b19-b67d-fcc93c950b1d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.028099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1fc46-9b9c-4b2d-9157-4800fe7c81ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.028099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1fc46-9b9c-4b2d-9157-4800fe7c81ac admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.028099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1fc46-9b9c-4b2d-9157-4800fe7c81ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.028099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1fc46-9b9c-4b2d-9157-4800fe7c81ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.028509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1fc46-9b9c-4b2d-9157-4800fe7c81ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.028509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1fc46-9b9c-4b2d-9157-4800fe7c81ac admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.037237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 801/1594] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:00.038323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1fc46-9b9c-4b2d-9157-4800fe7c81ac admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.051946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 794/1595] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:13:59 2022] PUT /identity/v3/projects/5af30325ad8e4d90a334078ff2a94db3/users/cc3cfbaa95774ccbb567374a99e2b25b/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:00.062673 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b815b-51f5-446e-9450-ac959d43fc4c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.105096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1fc46-9b9c-4b2d-9157-4800fe7c81ac admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.130520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b815b-51f5-446e-9450-ac959d43fc4c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.135719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36f04f-cc69-4b5f-b346-397717c0d933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.136428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36f04f-cc69-4b5f-b346-397717c0d933 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.136726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36f04f-cc69-4b5f-b346-397717c0d933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.137006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36f04f-cc69-4b5f-b346-397717c0d933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.137745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36f04f-cc69-4b5f-b346-397717c0d933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.139985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36f04f-cc69-4b5f-b346-397717c0d933 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.141412 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:00.151249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 795/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:00.160105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36f04f-cc69-4b5f-b346-397717c0d933 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.160327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f95fbc-d19f-47af-957e-df616bb0957e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.160985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f95fbc-d19f-47af-957e-df616bb0957e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.161275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f95fbc-d19f-47af-957e-df616bb0957e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.161559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f95fbc-d19f-47af-957e-df616bb0957e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.164075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36f04f-cc69-4b5f-b346-397717c0d933 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.170330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a30e50-dd08-48cd-b086-51a0f130eb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.171072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a30e50-dd08-48cd-b086-51a0f130eb2b admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.171361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a30e50-dd08-48cd-b086-51a0f130eb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.171638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a30e50-dd08-48cd-b086-51a0f130eb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.172407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a30e50-dd08-48cd-b086-51a0f130eb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.173168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f95fbc-d19f-47af-957e-df616bb0957e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.174000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a30e50-dd08-48cd-b086-51a0f130eb2b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.174897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f95fbc-d19f-47af-957e-df616bb0957e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.186118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 802/1597] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:00.187226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f95fbc-d19f-47af-957e-df616bb0957e service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.191178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 796/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:00.192298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a30e50-dd08-48cd-b086-51a0f130eb2b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.201150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f95fbc-d19f-47af-957e-df616bb0957e service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.202765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a30e50-dd08-48cd-b086-51a0f130eb2b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.207256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45355e-033c-4eff-affd-d651906c1fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.208148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45355e-033c-4eff-affd-d651906c1fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.208269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45355e-033c-4eff-affd-d651906c1fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.208502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45355e-033c-4eff-affd-d651906c1fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.209236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45355e-033c-4eff-affd-d651906c1fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.210889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45355e-033c-4eff-affd-d651906c1fb9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.212391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d98668-94ab-4c55-9df0-e1554dfcdbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.221232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d98668-94ab-4c55-9df0-e1554dfcdbff admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.221232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d98668-94ab-4c55-9df0-e1554dfcdbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.221232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d98668-94ab-4c55-9df0-e1554dfcdbff admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.221232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d98668-94ab-4c55-9df0-e1554dfcdbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.221232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d98668-94ab-4c55-9df0-e1554dfcdbff admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.222367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 797/1599] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:00.223311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45355e-033c-4eff-affd-d651906c1fb9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.231111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 803/1600] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:00.231111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416cc2c-c7c3-4a78-8206-6847a0fb86f9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.231111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416cc2c-c7c3-4a78-8206-6847a0fb86f9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.231111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416cc2c-c7c3-4a78-8206-6847a0fb86f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.238310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45355e-033c-4eff-affd-d651906c1fb9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.245169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cb666-6221-45fe-bd32-c4cdc669885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.246178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cb666-6221-45fe-bd32-c4cdc669885d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.246763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cb666-6221-45fe-bd32-c4cdc669885d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.247252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cb666-6221-45fe-bd32-c4cdc669885d admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.248710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cb666-6221-45fe-bd32-c4cdc669885d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.251357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cb666-6221-45fe-bd32-c4cdc669885d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.257270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3416cc2c-c7c3-4a78-8206-6847a0fb86f9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:00.259191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3416cc2c-c7c3-4a78-8206-6847a0fb86f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:00.265493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 798/1601] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:00.267332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cb666-6221-45fe-bd32-c4cdc669885d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.270719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 804/1602] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:00.271656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416cc2c-c7c3-4a78-8206-6847a0fb86f9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.285614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cb666-6221-45fe-bd32-c4cdc669885d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.286516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416cc2c-c7c3-4a78-8206-6847a0fb86f9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.293712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2d002-edeb-439b-aa1a-187b4048c83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.293973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7247cd-4efa-48e8-b64b-371c0fb79406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.295864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2d002-edeb-439b-aa1a-187b4048c83a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.296117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7247cd-4efa-48e8-b64b-371c0fb79406 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.296407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2d002-edeb-439b-aa1a-187b4048c83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.296834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7247cd-4efa-48e8-b64b-371c0fb79406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.296979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2d002-edeb-439b-aa1a-187b4048c83a admin admin] PATH_INFO: `/v3/projects/31cb5f5e23144db7888a0b371bee699d/users/b33074a324cb4fa194df522e17a01138/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.297851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7247cd-4efa-48e8-b64b-371c0fb79406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.299101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7247cd-4efa-48e8-b64b-371c0fb79406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.302777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7247cd-4efa-48e8-b64b-371c0fb79406 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.320690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 799/1603] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:00.321769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7247cd-4efa-48e8-b64b-371c0fb79406 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.325564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2d002-edeb-439b-aa1a-187b4048c83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cb5f5e23144db7888a0b371bee699d, user_id=b33074a324cb4fa194df522e17a01138, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.331516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2d002-edeb-439b-aa1a-187b4048c83a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.335946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7247cd-4efa-48e8-b64b-371c0fb79406 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.343833 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73f87f-87c5-4550-9c7b-a5ab11cd6f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.344804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73f87f-87c5-4550-9c7b-a5ab11cd6f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.345091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73f87f-87c5-4550-9c7b-a5ab11cd6f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.345377 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73f87f-87c5-4550-9c7b-a5ab11cd6f3f admin admin] PATH_INFO: `/v3/projects/03145eab0cf34b7aa5e547e19e797cd7/users/d00cf0d52666497891c7f9f45db3feeb/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.368227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73f87f-87c5-4550-9c7b-a5ab11cd6f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03145eab0cf34b7aa5e547e19e797cd7, user_id=d00cf0d52666497891c7f9f45db3feeb, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.371003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73f87f-87c5-4550-9c7b-a5ab11cd6f3f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.435585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 805/1604] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:00 2022] PUT /identity/v3/projects/31cb5f5e23144db7888a0b371bee699d/users/b33074a324cb4fa194df522e17a01138/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:00.440780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2d002-edeb-439b-aa1a-187b4048c83a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.461639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 800/1605] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:00 2022] PUT /identity/v3/projects/03145eab0cf34b7aa5e547e19e797cd7/users/d00cf0d52666497891c7f9f45db3feeb/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:00.480208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73f87f-87c5-4550-9c7b-a5ab11cd6f3f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.508315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:00.526260 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2d002-edeb-439b-aa1a-187b4048c83a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.564687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73f87f-87c5-4550-9c7b-a5ab11cd6f3f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.572727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2fecd-5426-4c14-a458-20683729ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.572727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2fecd-5426-4c14-a458-20683729ce26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.573729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2fecd-5426-4c14-a458-20683729ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.574253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2fecd-5426-4c14-a458-20683729ce26 admin admin] PATH_INFO: `/v3/projects/4b3456aa114f4c4391f9f49850a44c60/users/cb05d53d98c545688579fe10a88ed726/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.598845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2fecd-5426-4c14-a458-20683729ce26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3456aa114f4c4391f9f49850a44c60, user_id=cb05d53d98c545688579fe10a88ed726, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.601729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2fecd-5426-4c14-a458-20683729ce26 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.605203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c47ee-80b5-46e9-b36d-dc393818c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.606735 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c47ee-80b5-46e9-b36d-dc393818c28b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.608115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c47ee-80b5-46e9-b36d-dc393818c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.608547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c47ee-80b5-46e9-b36d-dc393818c28b admin admin] PATH_INFO: `/v3/projects/bb5588c2905e4d01b412db65b391ff8e/users/cd5e59993db94240a3b5da2f8fe7ce28/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.627345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c47ee-80b5-46e9-b36d-dc393818c28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5588c2905e4d01b412db65b391ff8e, user_id=cd5e59993db94240a3b5da2f8fe7ce28, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.630439 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c47ee-80b5-46e9-b36d-dc393818c28b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.680472 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 801/1606] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:00 2022] PUT /identity/v3/projects/4b3456aa114f4c4391f9f49850a44c60/users/cb05d53d98c545688579fe10a88ed726/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:00.681562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2fecd-5426-4c14-a458-20683729ce26 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.713493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 806/1607] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:00 2022] PUT /identity/v3/projects/bb5588c2905e4d01b412db65b391ff8e/users/cd5e59993db94240a3b5da2f8fe7ce28/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:00.714783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c47ee-80b5-46e9-b36d-dc393818c28b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:00.785429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2fecd-5426-4c14-a458-20683729ce26 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.801643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c47ee-80b5-46e9-b36d-dc393818c28b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:00.806946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8c5d-e9a0-479e-854d-99dbd665b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.808071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8c5d-e9a0-479e-854d-99dbd665b34e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.808358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8c5d-e9a0-479e-854d-99dbd665b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.808635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8c5d-e9a0-479e-854d-99dbd665b34e admin admin] PATH_INFO: `/v3/projects/822f7e11da824c2e99d16797e987fa09/users/41b13986fd754f0283047ddf865a19de/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.812928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:00.826020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c8c5d-e9a0-479e-854d-99dbd665b34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=822f7e11da824c2e99d16797e987fa09, user_id=41b13986fd754f0283047ddf865a19de, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.828863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c8c5d-e9a0-479e-854d-99dbd665b34e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.845913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a2977-156b-4ac3-8e2d-2029895de3db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:00.846573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a2977-156b-4ac3-8e2d-2029895de3db service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.846883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a2977-156b-4ac3-8e2d-2029895de3db service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.847157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a2977-156b-4ac3-8e2d-2029895de3db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.859523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a2977-156b-4ac3-8e2d-2029895de3db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:00.861260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a2977-156b-4ac3-8e2d-2029895de3db service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:00.872241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 802/1608] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:00.874432 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7b647-d8d6-45ff-92d3-807182bbae1b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.874432 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7b647-d8d6-45ff-92d3-807182bbae1b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.874774 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7b647-d8d6-45ff-92d3-807182bbae1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.900690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5fb7b647-d8d6-45ff-92d3-807182bbae1b None None] MFA Rules not processed for user `b33074a324cb4fa194df522e17a01138`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:00.902063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5fb7b647-d8d6-45ff-92d3-807182bbae1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:00.943539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 807/1609] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:00 2022] PUT /identity/v3/projects/822f7e11da824c2e99d16797e987fa09/users/41b13986fd754f0283047ddf865a19de/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:00.949057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0ed4-a2c9-4266-bce9-f3dae01e29c8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:00.949057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0ed4-a2c9-4266-bce9-f3dae01e29c8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:00.949057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0ed4-a2c9-4266-bce9-f3dae01e29c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:00.980798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9a6d0ed4-a2c9-4266-bce9-f3dae01e29c8 None None] MFA Rules not processed for user `d00cf0d52666497891c7f9f45db3feeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:00.986387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a6d0ed4-a2c9-4266-bce9-f3dae01e29c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:01.022641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 803/1610] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:01.041776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:01.047215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a388daa-e617-4618-8ec9-ec3a42635365 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.048396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a388daa-e617-4618-8ec9-ec3a42635365 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.048773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a388daa-e617-4618-8ec9-ec3a42635365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.105461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 808/1611] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:01.110517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00148866-7f7b-4194-bc9e-d881bb08d18a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.113018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00148866-7f7b-4194-bc9e-d881bb08d18a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.113018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00148866-7f7b-4194-bc9e-d881bb08d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.117291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3a388daa-e617-4618-8ec9-ec3a42635365 None None] MFA Rules not processed for user `cb05d53d98c545688579fe10a88ed726`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:01.121349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3a388daa-e617-4618-8ec9-ec3a42635365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:01.166196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-00148866-7f7b-4194-bc9e-d881bb08d18a None None] MFA Rules not processed for user `cd5e59993db94240a3b5da2f8fe7ce28`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:01.167343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-00148866-7f7b-4194-bc9e-d881bb08d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:01.214880 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 804/1612] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:01.217884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8560619-8be5-49df-b66e-59124d8fd644 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.218292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8560619-8be5-49df-b66e-59124d8fd644 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.218679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8560619-8be5-49df-b66e-59124d8fd644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.240011 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f8560619-8be5-49df-b66e-59124d8fd644 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:01.247059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f8560619-8be5-49df-b66e-59124d8fd644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:01.300389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 809/1613] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:01.300389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00148866-7f7b-4194-bc9e-d881bb08d18a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:01.320134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 805/1614] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:01.321577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d19dd9-c3c6-45cc-aab0-f4dfc093395e None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.321864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d19dd9-c3c6-45cc-aab0-f4dfc093395e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.322139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d19dd9-c3c6-45cc-aab0-f4dfc093395e None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.336596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 806/1615] 10.222.0.49 () {54 vars in 961 bytes} [Tue Jun 28 12:14:01 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:01.337503 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d19dd9-c3c6-45cc-aab0-f4dfc093395e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:01.381668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d19dd9-c3c6-45cc-aab0-f4dfc093395e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:01.394795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892603e-a527-4202-9737-549e961f065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:01.395829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892603e-a527-4202-9737-549e961f065a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.396352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892603e-a527-4202-9737-549e961f065a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.396643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892603e-a527-4202-9737-549e961f065a admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.397360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892603e-a527-4202-9737-549e961f065a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:01.401551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892603e-a527-4202-9737-549e961f065a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:01.427129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00148866-7f7b-4194-bc9e-d881bb08d18a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:01.462386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e80836-0b9f-48fc-a2e3-d2fa48c5bc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:01.463284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e80836-0b9f-48fc-a2e3-d2fa48c5bc81 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.463663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e80836-0b9f-48fc-a2e3-d2fa48c5bc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.464227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e80836-0b9f-48fc-a2e3-d2fa48c5bc81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.465113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e80836-0b9f-48fc-a2e3-d2fa48c5bc81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:01.467574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e80836-0b9f-48fc-a2e3-d2fa48c5bc81 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:01.517720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 807/1616] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:01 2022] POST /identity/v3/projects => generated 357 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:01.517720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892603e-a527-4202-9737-549e961f065a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:01.532470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:01.580047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 810/1617] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:01 2022] POST /identity/v3/projects => generated 367 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:01.584093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e55e6-88d8-4fdd-a79a-1ec5a4b36cb4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.584426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e55e6-88d8-4fdd-a79a-1ec5a4b36cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.584707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e55e6-88d8-4fdd-a79a-1ec5a4b36cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.604238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ab0e55e6-88d8-4fdd-a79a-1ec5a4b36cb4 None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:01.604979 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892603e-a527-4202-9737-549e961f065a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:01.605451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab0e55e6-88d8-4fdd-a79a-1ec5a4b36cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:01.761596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfedc7-4b79-4c90-a1ae-594042df2774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:01.761596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfedc7-4b79-4c90-a1ae-594042df2774 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.761596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfedc7-4b79-4c90-a1ae-594042df2774 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.761596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfedc7-4b79-4c90-a1ae-594042df2774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.764336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 811/1618] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Jun 28 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:01.764336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56398865-7628-412b-ba57-3dc45c4d1119 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.764336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56398865-7628-412b-ba57-3dc45c4d1119 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.764336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56398865-7628-412b-ba57-3dc45c4d1119 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.764336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 812/1619] 10.222.0.49 () {54 vars in 961 bytes} [Tue Jun 28 12:14:01 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:01.764336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56398865-7628-412b-ba57-3dc45c4d1119 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:01.804044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:01.831358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfedc7-4b79-4c90-a1ae-594042df2774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:01.833003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfedc7-4b79-4c90-a1ae-594042df2774 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:01.855967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 808/1620] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:01.858855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfedc7-4b79-4c90-a1ae-594042df2774 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:01.870379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfedc7-4b79-4c90-a1ae-594042df2774 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:01.877652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc384214-c1c1-48bb-9c1a-3f5dd501aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:01.878336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384214-c1c1-48bb-9c1a-3f5dd501aafd admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.878981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384214-c1c1-48bb-9c1a-3f5dd501aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.879298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384214-c1c1-48bb-9c1a-3f5dd501aafd admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.880136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc384214-c1c1-48bb-9c1a-3f5dd501aafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:01.885686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc384214-c1c1-48bb-9c1a-3f5dd501aafd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:01.936514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56398865-7628-412b-ba57-3dc45c4d1119 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:01.945525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12438777-5aa2-4091-bf27-7bffb36b9f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:01.946364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12438777-5aa2-4091-bf27-7bffb36b9f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:01.947451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12438777-5aa2-4091-bf27-7bffb36b9f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:01.947848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12438777-5aa2-4091-bf27-7bffb36b9f64 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:01.951661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12438777-5aa2-4091-bf27-7bffb36b9f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:01.951661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12438777-5aa2-4091-bf27-7bffb36b9f64 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:02.001810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 809/1621] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:01 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:02.002669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc384214-c1c1-48bb-9c1a-3f5dd501aafd admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:02.020035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc384214-c1c1-48bb-9c1a-3f5dd501aafd admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:02.034117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4894064-190c-4837-a3be-2b11a9f81a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:02.034966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4894064-190c-4837-a3be-2b11a9f81a3c service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.035352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4894064-190c-4837-a3be-2b11a9f81a3c service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.036068 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4894064-190c-4837-a3be-2b11a9f81a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.128531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 813/1622] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:01 2022] POST /identity/v3/users => generated 285 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:02.128531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3243ad-b515-408d-bb04-f0d9f7eb5b3e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.128531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3243ad-b515-408d-bb04-f0d9f7eb5b3e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.128881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3243ad-b515-408d-bb04-f0d9f7eb5b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.146990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4894064-190c-4837-a3be-2b11a9f81a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:02.149403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4894064-190c-4837-a3be-2b11a9f81a3c service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:02.172478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 810/1623] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:02.173824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4894064-190c-4837-a3be-2b11a9f81a3c service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:02.192688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5b3243ad-b515-408d-bb04-f0d9f7eb5b3e None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:02.194036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5b3243ad-b515-408d-bb04-f0d9f7eb5b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:02.207349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4894064-190c-4837-a3be-2b11a9f81a3c service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:02.232632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 814/1624] 10.222.0.49 () {58 vars in 1058 bytes} [Tue Jun 28 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:02.234055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3243ad-b515-408d-bb04-f0d9f7eb5b3e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:02.241893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3225a-57cc-4737-b629-731b0b355b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:02.243109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3225a-57cc-4737-b629-731b0b355b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.243623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3225a-57cc-4737-b629-731b0b355b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.244169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3225a-57cc-4737-b629-731b0b355b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.248094 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3225a-57cc-4737-b629-731b0b355b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:02.250080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3225a-57cc-4737-b629-731b0b355b28 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:02.265711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3243ad-b515-408d-bb04-f0d9f7eb5b3e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:02.273548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77cbe6-e2f1-4e05-a983-23f3e4ad3ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:02.274776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77cbe6-e2f1-4e05-a983-23f3e4ad3ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.275160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77cbe6-e2f1-4e05-a983-23f3e4ad3ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.275335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77cbe6-e2f1-4e05-a983-23f3e4ad3ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.276544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77cbe6-e2f1-4e05-a983-23f3e4ad3ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:02.285793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77cbe6-e2f1-4e05-a983-23f3e4ad3ae8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:02.287327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 811/1625] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:02.289982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3225a-57cc-4737-b629-731b0b355b28 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:02.313982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 815/1626] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:02.319165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3225a-57cc-4737-b629-731b0b355b28 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:02.319986 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77cbe6-e2f1-4e05-a983-23f3e4ad3ae8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:02.327500 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dd795-74e8-45b9-a291-a9244adef183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:02.328659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dd795-74e8-45b9-a291-a9244adef183 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.329174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dd795-74e8-45b9-a291-a9244adef183 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.329762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dd795-74e8-45b9-a291-a9244adef183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.345298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:02.350583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77cbe6-e2f1-4e05-a983-23f3e4ad3ae8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:02.376946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd807034-169e-499d-81a0-43160405db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:02.378156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd807034-169e-499d-81a0-43160405db55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.378156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd807034-169e-499d-81a0-43160405db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.378633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd807034-169e-499d-81a0-43160405db55 admin admin] PATH_INFO: `/v3/projects/63fd0baf9ab245738ebed3033a141ade/users/a2dc1429c582435ca2afaede4bc22b49/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.424966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd807034-169e-499d-81a0-43160405db55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fd0baf9ab245738ebed3033a141ade, user_id=a2dc1429c582435ca2afaede4bc22b49, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:02.427794 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd807034-169e-499d-81a0-43160405db55 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:02.464486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dd795-74e8-45b9-a291-a9244adef183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:02.467422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dd795-74e8-45b9-a291-a9244adef183 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:02.523436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 812/1628] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:02.524094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 816/1628] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:02 2022] PUT /identity/v3/projects/63fd0baf9ab245738ebed3033a141ade/users/a2dc1429c582435ca2afaede4bc22b49/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:02.525858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dd795-74e8-45b9-a291-a9244adef183 service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:02.526032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd807034-169e-499d-81a0-43160405db55 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:02.583391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dd795-74e8-45b9-a291-a9244adef183 service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:02.680527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd807034-169e-499d-81a0-43160405db55 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:02.694617 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e76b-edae-4ea2-8594-d7681311b295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:02.695647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e76b-edae-4ea2-8594-d7681311b295 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.696195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e76b-edae-4ea2-8594-d7681311b295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.696653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797e76b-edae-4ea2-8594-d7681311b295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.697564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e76b-edae-4ea2-8594-d7681311b295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:02.699370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797e76b-edae-4ea2-8594-d7681311b295 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:02.729593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 817/1629] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:02.730517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e76b-edae-4ea2-8594-d7681311b295 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:02.756437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797e76b-edae-4ea2-8594-d7681311b295 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:02.767771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9263d6e-63c3-4ab9-b572-96f3aaf2eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:02.768751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9263d6e-63c3-4ab9-b572-96f3aaf2eed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.769031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9263d6e-63c3-4ab9-b572-96f3aaf2eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.769313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9263d6e-63c3-4ab9-b572-96f3aaf2eed4 admin admin] PATH_INFO: `/v3/projects/63fd0baf9ab245738ebed3033a141ade/users/a2dc1429c582435ca2afaede4bc22b49/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.771495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9263d6e-63c3-4ab9-b572-96f3aaf2eed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fd0baf9ab245738ebed3033a141ade, user_id=a2dc1429c582435ca2afaede4bc22b49, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:02.774239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9263d6e-63c3-4ab9-b572-96f3aaf2eed4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:02.798539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bb643-cfb9-4477-a1b2-34f954c7b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:02.800306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb643-cfb9-4477-a1b2-34f954c7b347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.801463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb643-cfb9-4477-a1b2-34f954c7b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.801906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb643-cfb9-4477-a1b2-34f954c7b347 admin admin] PATH_INFO: `/v3/projects/5bdecff7262c412d9cbfe219ea4bd80b/users/b4669dd1e67d4326a061af77981cd199/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.813612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 818/1630] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:02 2022] PUT /identity/v3/projects/63fd0baf9ab245738ebed3033a141ade/users/a2dc1429c582435ca2afaede4bc22b49/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:02.815591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b485-b839-4aea-a4b1-887c535ed58a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.815780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b485-b839-4aea-a4b1-887c535ed58a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.816094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b485-b839-4aea-a4b1-887c535ed58a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.817587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 819/1631] 10.222.0.49 () {54 vars in 912 bytes} [Tue Jun 28 12:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:02.822963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c6aaa-a6a5-48d8-8f60-fc08cbcb6365 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.823389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c6aaa-a6a5-48d8-8f60-fc08cbcb6365 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.832219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c6aaa-a6a5-48d8-8f60-fc08cbcb6365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:02.842948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bb643-cfb9-4477-a1b2-34f954c7b347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdecff7262c412d9cbfe219ea4bd80b, user_id=b4669dd1e67d4326a061af77981cd199, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:02.856360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bb643-cfb9-4477-a1b2-34f954c7b347 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:02.892974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2a3c6aaa-a6a5-48d8-8f60-fc08cbcb6365 None None] MFA Rules not processed for user `a2dc1429c582435ca2afaede4bc22b49`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:02.894375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2a3c6aaa-a6a5-48d8-8f60-fc08cbcb6365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:02.972147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 813/1632] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:02 2022] PUT /identity/v3/projects/5bdecff7262c412d9cbfe219ea4bd80b/users/b4669dd1e67d4326a061af77981cd199/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:02.974837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5592b3e-51fd-47c5-9014-958ed66f46b0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:02.974837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5592b3e-51fd-47c5-9014-958ed66f46b0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:02.974837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5592b3e-51fd-47c5-9014-958ed66f46b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:03.018107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d5592b3e-51fd-47c5-9014-958ed66f46b0 None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:03.020406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d5592b3e-51fd-47c5-9014-958ed66f46b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:03.050545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:03.078035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 820/1633] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:03.079225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c6aaa-a6a5-48d8-8f60-fc08cbcb6365 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:03.155033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 814/1634] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:03.158205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847273-643c-4ec2-b8e2-1447c38c0dfe None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:03.158502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847273-643c-4ec2-b8e2-1447c38c0dfe None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:03.158785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847273-643c-4ec2-b8e2-1447c38c0dfe None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:03.160343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 815/1635] 10.222.0.49 () {54 vars in 912 bytes} [Tue Jun 28 12:14:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:03.160938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847273-643c-4ec2-b8e2-1447c38c0dfe None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:03.191627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c6aaa-a6a5-48d8-8f60-fc08cbcb6365 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:03.239697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:03.275833 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847273-643c-4ec2-b8e2-1447c38c0dfe None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:03.287768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8db953-cafb-4997-a621-d65eecc64d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:03.290656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8db953-cafb-4997-a621-d65eecc64d00 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:03.290943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8db953-cafb-4997-a621-d65eecc64d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:03.291220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8db953-cafb-4997-a621-d65eecc64d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:03.295217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445c004-5f4b-4fa3-adf2-6b72688a4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:03.296434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c004-5f4b-4fa3-adf2-6b72688a4bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:03.296434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c004-5f4b-4fa3-adf2-6b72688a4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:03.296434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c004-5f4b-4fa3-adf2-6b72688a4bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:03.302101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445c004-5f4b-4fa3-adf2-6b72688a4bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:03.304434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445c004-5f4b-4fa3-adf2-6b72688a4bc0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:03.335246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 821/1636] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:03.338540 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb79e-6969-4fd9-a52e-a2e0fbbce92c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:03.338849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb79e-6969-4fd9-a52e-a2e0fbbce92c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:03.344127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfb79e-6969-4fd9-a52e-a2e0fbbce92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:03.373153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5ddfb79e-6969-4fd9-a52e-a2e0fbbce92c None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:03.374820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5ddfb79e-6969-4fd9-a52e-a2e0fbbce92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:03.395988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 822/1637] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:03.397331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfb79e-6969-4fd9-a52e-a2e0fbbce92c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:03.402961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8db953-cafb-4997-a621-d65eecc64d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:03.404497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8db953-cafb-4997-a621-d65eecc64d00 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:03.411198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfb79e-6969-4fd9-a52e-a2e0fbbce92c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:03.417389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 816/1638] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:03.418200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8db953-cafb-4997-a621-d65eecc64d00 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:03.421685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8552533-a1f1-4080-97d4-f1f776e14542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:03.422345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8552533-a1f1-4080-97d4-f1f776e14542 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:03.422628 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8552533-a1f1-4080-97d4-f1f776e14542 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:03.422903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8552533-a1f1-4080-97d4-f1f776e14542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:03.451089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8db953-cafb-4997-a621-d65eecc64d00 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:03.452522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8552533-a1f1-4080-97d4-f1f776e14542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:03.457988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8552533-a1f1-4080-97d4-f1f776e14542 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:03.464453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad24228-6b4b-41e1-80f6-e757ecab810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:03.466370 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad24228-6b4b-41e1-80f6-e757ecab810d admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:03.469770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad24228-6b4b-41e1-80f6-e757ecab810d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:03.470450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad24228-6b4b-41e1-80f6-e757ecab810d admin admin] PATH_INFO: `/v3/projects/5bdecff7262c412d9cbfe219ea4bd80b/users/b4669dd1e67d4326a061af77981cd199/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:03.475312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad24228-6b4b-41e1-80f6-e757ecab810d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdecff7262c412d9cbfe219ea4bd80b, user_id=b4669dd1e67d4326a061af77981cd199, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:03.483144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad24228-6b4b-41e1-80f6-e757ecab810d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:03.493534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 823/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:03.510555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 817/1640] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:03 2022] PUT /identity/v3/projects/5bdecff7262c412d9cbfe219ea4bd80b/users/b4669dd1e67d4326a061af77981cd199/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:03.531698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b981e-15eb-4261-a917-fd4837066199 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:03.532085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b981e-15eb-4261-a917-fd4837066199 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:03.532272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b981e-15eb-4261-a917-fd4837066199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:03.570219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-114b981e-15eb-4261-a917-fd4837066199 None None] MFA Rules not processed for user `b4669dd1e67d4326a061af77981cd199`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:03.572346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-114b981e-15eb-4261-a917-fd4837066199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:03.590878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad24228-6b4b-41e1-80f6-e757ecab810d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:03.680040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 824/1641] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:03.706288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad24228-6b4b-41e1-80f6-e757ecab810d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:03.713480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0015ba-1f9d-4b42-b2e0-7e7d8025b894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:03.714146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0015ba-1f9d-4b42-b2e0-7e7d8025b894 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:03.714428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0015ba-1f9d-4b42-b2e0-7e7d8025b894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:03.714700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0015ba-1f9d-4b42-b2e0-7e7d8025b894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:03.839072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:03.911679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0015ba-1f9d-4b42-b2e0-7e7d8025b894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:03.915147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0015ba-1f9d-4b42-b2e0-7e7d8025b894 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:03.942075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 818/1642] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:04.227502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:05.371500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b981e-15eb-4261-a917-fd4837066199 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:05.371500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b981e-15eb-4261-a917-fd4837066199 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:05.371500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41c56-f280-41f9-913a-f8574bf9c851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:05.371500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41c56-f280-41f9-913a-f8574bf9c851 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:05.376428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41c56-f280-41f9-913a-f8574bf9c851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:05.376428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f41c56-f280-41f9-913a-f8574bf9c851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:05.376428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f41c56-f280-41f9-913a-f8574bf9c851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:05.376428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f41c56-f280-41f9-913a-f8574bf9c851 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:05.376428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 825/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:05 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:05.854759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0015ba-1f9d-4b42-b2e0-7e7d8025b894 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:05.870555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0015ba-1f9d-4b42-b2e0-7e7d8025b894 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:05.885007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee81a08-b2ff-455c-985a-be8fab629e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:05.885725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee81a08-b2ff-455c-985a-be8fab629e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:05.886107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee81a08-b2ff-455c-985a-be8fab629e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:05.886444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee81a08-b2ff-455c-985a-be8fab629e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:06.079898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee81a08-b2ff-455c-985a-be8fab629e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:06.081486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee81a08-b2ff-455c-985a-be8fab629e77 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:06.113324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 819/1644] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:05 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:09.140129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41c56-f280-41f9-913a-f8574bf9c851 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:09.318126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f41c56-f280-41f9-913a-f8574bf9c851 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:09.343963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:09.344874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:09.345161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:09.345428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] PATH_INFO: `/v3/users/b33074a324cb4fa194df522e17a01138` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:09.347093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33074a324cb4fa194df522e17a01138)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:09.348166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:14:09.348166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 28 12:14:09.348166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: Jun 28 12:14:09.349388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:09.646606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33074a324cb4fa194df522e17a01138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:09.685216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33074a324cb4fa194df522e17a01138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:09.686449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33074a324cb4fa194df522e17a01138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:09.735111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33074a324cb4fa194df522e17a01138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:09.850426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33074a324cb4fa194df522e17a01138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:09.861672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 826/1645] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:09 2022] DELETE /identity/v3/users/b33074a324cb4fa194df522e17a01138 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:09.872263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195d3ea-13cc-4c29-af05-9c94a789f2a3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:09.872263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195d3ea-13cc-4c29-af05-9c94a789f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:09.872263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195d3ea-13cc-4c29-af05-9c94a789f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:09.915520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b195d3ea-13cc-4c29-af05-9c94a789f2a3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:09.917083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b195d3ea-13cc-4c29-af05-9c94a789f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:10.130855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 820/1646] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:10.202081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:10.202081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:10.322744 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:10.406165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce7ee5-09dd-4516-8063-63b83b385cd9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:10.417603 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640492f-4e0e-4158-9a16-0c28485bb107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:10.420279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640492f-4e0e-4158-9a16-0c28485bb107 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:10.420737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640492f-4e0e-4158-9a16-0c28485bb107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:10.421177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640492f-4e0e-4158-9a16-0c28485bb107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:10.454541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640492f-4e0e-4158-9a16-0c28485bb107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:10.461170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640492f-4e0e-4158-9a16-0c28485bb107 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:10.492257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 827/1647] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:11.390685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195d3ea-13cc-4c29-af05-9c94a789f2a3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:11.393031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b195d3ea-13cc-4c29-af05-9c94a789f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:11.422140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195d3ea-13cc-4c29-af05-9c94a789f2a3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:11.443816 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:11.444759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:11.445249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:11.445711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] PATH_INFO: `/v3/users/d00cf0d52666497891c7f9f45db3feeb` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:11.448463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00cf0d52666497891c7f9f45db3feeb)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:11.456870 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:11.476953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e61418-dee9-42c6-94a1-952b4e1e2885 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:11.477739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e61418-dee9-42c6-94a1-952b4e1e2885 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:11.478183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e61418-dee9-42c6-94a1-952b4e1e2885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:11.511124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-11e61418-dee9-42c6-94a1-952b4e1e2885 None None] MFA Rules not processed for user `6cebe6f32ada4875b7777d90ef52b677`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:11.512913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11e61418-dee9-42c6-94a1-952b4e1e2885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:11.640063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 828/1648] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:11.662863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27058-b603-4f6e-916e-0f6ed5c94fd2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:11.663163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27058-b603-4f6e-916e-0f6ed5c94fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:11.664656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27058-b603-4f6e-916e-0f6ed5c94fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:11.694957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a8c27058-b603-4f6e-916e-0f6ed5c94fd2 None None] MFA Rules not processed for user `6cebe6f32ada4875b7777d90ef52b677`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:11.696659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a8c27058-b603-4f6e-916e-0f6ed5c94fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:11.698788 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:11.711463 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 829/1649] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:11.720304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c27058-b603-4f6e-916e-0f6ed5c94fd2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:11.722176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a8c27058-b603-4f6e-916e-0f6ed5c94fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:11.849240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00cf0d52666497891c7f9f45db3feeb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:11.881793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00cf0d52666497891c7f9f45db3feeb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:11.930132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c27058-b603-4f6e-916e-0f6ed5c94fd2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:11.952090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597064-b5f7-4347-816b-97d913b5f971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:11.952938 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597064-b5f7-4347-816b-97d913b5f971 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:11.954991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597064-b5f7-4347-816b-97d913b5f971 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:11.954991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597064-b5f7-4347-816b-97d913b5f971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:11.979374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597064-b5f7-4347-816b-97d913b5f971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:11.983753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597064-b5f7-4347-816b-97d913b5f971 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:12.013184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 830/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:12.015058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597064-b5f7-4347-816b-97d913b5f971 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:12.017577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00cf0d52666497891c7f9f45db3feeb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:12.018646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a597064-b5f7-4347-816b-97d913b5f971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:12.020128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00cf0d52666497891c7f9f45db3feeb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:12.066794 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597064-b5f7-4347-816b-97d913b5f971 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:12.076693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-88867e2b-348e-4436-af98-c703ac1aeb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00cf0d52666497891c7f9f45db3feeb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:12.088359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:12.089784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:12.090189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:12.090478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] PATH_INFO: `/v3/projects/31cb5f5e23144db7888a0b371bee699d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:12.092427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cb5f5e23144db7888a0b371bee699d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:12.094389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:12.101541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 821/1651] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:11 2022] DELETE /identity/v3/users/d00cf0d52666497891c7f9f45db3feeb => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:12.112208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc010f8a-9dce-4f30-bff9-d728426f2228 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:12.118282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc010f8a-9dce-4f30-bff9-d728426f2228 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:12.118748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc010f8a-9dce-4f30-bff9-d728426f2228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:12.170613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-fc010f8a-9dce-4f30-bff9-d728426f2228 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:12.172532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fc010f8a-9dce-4f30-bff9-d728426f2228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:12.228424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:12.259229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cb5f5e23144db7888a0b371bee699d', 'request_id': 'req-3ff82149-14cb-4dbe-8136-a4d44d068d67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:12.273119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 822/1652] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:12.302430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc010f8a-9dce-4f30-bff9-d728426f2228 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:12.306058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fc010f8a-9dce-4f30-bff9-d728426f2228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:12.386848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cb5f5e23144db7888a0b371bee699d', 'request_id': 'req-3ff82149-14cb-4dbe-8136-a4d44d068d67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:12.399397 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cb5f5e23144db7888a0b371bee699d', 'request_id': 'req-3ff82149-14cb-4dbe-8136-a4d44d068d67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:12.424289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] The token cache is being invalidate because project 31cb5f5e23144db7888a0b371bee699d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:12.425661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:12.426616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ff82149-14cb-4dbe-8136-a4d44d068d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:12.437430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 831/1653] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:12 2022] DELETE /identity/v3/projects/31cb5f5e23144db7888a0b371bee699d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:12.437613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc010f8a-9dce-4f30-bff9-d728426f2228 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:12.441010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56001f2-655e-4d7b-8cca-57c10edc669b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:12.442058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56001f2-655e-4d7b-8cca-57c10edc669b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:12.444037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56001f2-655e-4d7b-8cca-57c10edc669b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:12.495035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b56001f2-655e-4d7b-8cca-57c10edc669b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:12.506402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b56001f2-655e-4d7b-8cca-57c10edc669b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:12.611932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa6547-4d9a-464d-87bf-b5b59c1b04df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:12.613473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6547-4d9a-464d-87bf-b5b59c1b04df service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:12.613763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6547-4d9a-464d-87bf-b5b59c1b04df service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:12.614040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa6547-4d9a-464d-87bf-b5b59c1b04df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:12.618309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8cfa6547-4d9a-464d-87bf-b5b59c1b04df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:12.704329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 832/1654] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:12.713788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a18ce-fe8e-4055-ac32-cc9421edf80d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:12.714084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a18ce-fe8e-4055-ac32-cc9421edf80d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:12.714366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a18ce-fe8e-4055-ac32-cc9421edf80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:12.759141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3f9a18ce-fe8e-4055-ac32-cc9421edf80d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:12.760393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3f9a18ce-fe8e-4055-ac32-cc9421edf80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:12.784098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 833/1655] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:12.785411 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa6547-4d9a-464d-87bf-b5b59c1b04df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:12.787389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a18ce-fe8e-4055-ac32-cc9421edf80d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:12.790988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa6547-4d9a-464d-87bf-b5b59c1b04df service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:12.811302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a18ce-fe8e-4055-ac32-cc9421edf80d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:12.826204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 823/1656] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:12.830388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:12.833084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:12.835977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:12.835977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:12.835977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:12.835977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:12.836970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:12.864377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 834/1657] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:14:12.869923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa6547-4d9a-464d-87bf-b5b59c1b04df service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:12.888024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa6547-4d9a-464d-87bf-b5b59c1b04df service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:12.922571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24637ff0-39f5-4d32-ba85-5b098b1ff38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:12.927723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24637ff0-39f5-4d32-ba85-5b098b1ff38b admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:12.930397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24637ff0-39f5-4d32-ba85-5b098b1ff38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:12.939926 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24637ff0-39f5-4d32-ba85-5b098b1ff38b admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:12.941087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24637ff0-39f5-4d32-ba85-5b098b1ff38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:12.943138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24637ff0-39f5-4d32-ba85-5b098b1ff38b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:13.013788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:13.016665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:13.046858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc63489-4ccb-48dd-a10f-44dd84562980 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:13.053858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:13.055144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:13.055262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:13.055798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] PATH_INFO: `/v3/users/cd5e59993db94240a3b5da2f8fe7ce28` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:13.058745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5e59993db94240a3b5da2f8fe7ce28)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:13.061069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:13.077159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 824/1658] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:12 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:13.081026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24637ff0-39f5-4d32-ba85-5b098b1ff38b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:13.134910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:13.273610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24637ff0-39f5-4d32-ba85-5b098b1ff38b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:13.288804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8f3f-7d55-4cf8-97c7-f2591e01718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:13.291350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8f3f-7d55-4cf8-97c7-f2591e01718e admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:13.293115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8f3f-7d55-4cf8-97c7-f2591e01718e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:13.293115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8f3f-7d55-4cf8-97c7-f2591e01718e admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:13.294700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8f3f-7d55-4cf8-97c7-f2591e01718e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:13.299833 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8f3f-7d55-4cf8-97c7-f2591e01718e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:13.406952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 825/1659] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:13 2022] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:13.412041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8f3f-7d55-4cf8-97c7-f2591e01718e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:13.436570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8f3f-7d55-4cf8-97c7-f2591e01718e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:13.442559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5e59993db94240a3b5da2f8fe7ce28'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:13.451572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10581d-c459-4831-abf4-8fc861afb591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:13.453731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10581d-c459-4831-abf4-8fc861afb591 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:13.454024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10581d-c459-4831-abf4-8fc861afb591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:13.454227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5e59993db94240a3b5da2f8fe7ce28'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:13.454324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10581d-c459-4831-abf4-8fc861afb591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:13.455980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5e59993db94240a3b5da2f8fe7ce28'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:13.456936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10581d-c459-4831-abf4-8fc861afb591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:13.462398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10581d-c459-4831-abf4-8fc861afb591 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:13.499776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5e59993db94240a3b5da2f8fe7ce28'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:13.504977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 826/1660] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:13.509921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10581d-c459-4831-abf4-8fc861afb591 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:13.531110 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10581d-c459-4831-abf4-8fc861afb591 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:13.544235 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3332cc-0921-44d9-b5a2-b3406c476473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:13.552189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3332cc-0921-44d9-b5a2-b3406c476473 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:13.552189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3332cc-0921-44d9-b5a2-b3406c476473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:13.552189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3332cc-0921-44d9-b5a2-b3406c476473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:13.552189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3332cc-0921-44d9-b5a2-b3406c476473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:13.556883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3332cc-0921-44d9-b5a2-b3406c476473 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:13.595624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 827/1661] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:13.599897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3332cc-0921-44d9-b5a2-b3406c476473 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:13.638587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85d209ee-6db5-4fdc-b13f-0b747388520a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5e59993db94240a3b5da2f8fe7ce28'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:13.648458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3332cc-0921-44d9-b5a2-b3406c476473 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:13.656465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 835/1662] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:13 2022] DELETE /identity/v3/users/cd5e59993db94240a3b5da2f8fe7ce28 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:13.661517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b803d7-5726-4b00-8492-ca2204239cb8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:13.661807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b803d7-5726-4b00-8492-ca2204239cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:13.662092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b803d7-5726-4b00-8492-ca2204239cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:13.666280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e966fe5-b480-4f42-aae1-aeca9056fac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:13.669125 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e966fe5-b480-4f42-aae1-aeca9056fac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:13.672465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e966fe5-b480-4f42-aae1-aeca9056fac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:13.672465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e966fe5-b480-4f42-aae1-aeca9056fac2 admin admin] PATH_INFO: `/v3/projects/e10ef1285daf42ef80208d8ddc55e081/users/77207234acad44f28cbe59c185c3c046/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:13.727915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e966fe5-b480-4f42-aae1-aeca9056fac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10ef1285daf42ef80208d8ddc55e081, user_id=77207234acad44f28cbe59c185c3c046, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:13.734935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e966fe5-b480-4f42-aae1-aeca9056fac2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:13.778280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-11b803d7-5726-4b00-8492-ca2204239cb8 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:13.779758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11b803d7-5726-4b00-8492-ca2204239cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:13.824765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:13.869184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 828/1663] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:13 2022] PUT /identity/v3/projects/e10ef1285daf42ef80208d8ddc55e081/users/77207234acad44f28cbe59c185c3c046/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:13.880410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c2eef-0b62-4a08-957d-7a2a8ea6063e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:13.881061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c2eef-0b62-4a08-957d-7a2a8ea6063e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:13.881537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c2eef-0b62-4a08-957d-7a2a8ea6063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:14.008548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4c2c2eef-0b62-4a08-957d-7a2a8ea6063e None None] MFA Rules not processed for user `77207234acad44f28cbe59c185c3c046`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:14.014109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4c2c2eef-0b62-4a08-957d-7a2a8ea6063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:14.100451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 836/1664] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:14.100451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b61abb-b2e9-4d7f-8850-bb11533d93ce None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:14.100451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b61abb-b2e9-4d7f-8850-bb11533d93ce None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:14.100451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b61abb-b2e9-4d7f-8850-bb11533d93ce None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:14.100873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 837/1665] 10.222.0.49 () {54 vars in 912 bytes} [Tue Jun 28 12:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:14.114121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc26c05-84fc-4711-a935-068c4956c7dd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:14.114121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc26c05-84fc-4711-a935-068c4956c7dd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:14.114359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc26c05-84fc-4711-a935-068c4956c7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:14.183101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 829/1666] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:14.188835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c2eef-0b62-4a08-957d-7a2a8ea6063e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:14.192626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4c2c2eef-0b62-4a08-957d-7a2a8ea6063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:14.254802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3cc26c05-84fc-4711-a935-068c4956c7dd None None] MFA Rules not processed for user `3ff61c1fbdf34fa38588e4cd2cdc5398`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:14.260344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3cc26c05-84fc-4711-a935-068c4956c7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:14.297379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c2eef-0b62-4a08-957d-7a2a8ea6063e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:14.303727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20204795-b63a-4c0a-8607-4723165080c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:14.304646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20204795-b63a-4c0a-8607-4723165080c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:14.316087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20204795-b63a-4c0a-8607-4723165080c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:14.316087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20204795-b63a-4c0a-8607-4723165080c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:14.316087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20204795-b63a-4c0a-8607-4723165080c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:14.316087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20204795-b63a-4c0a-8607-4723165080c1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:14.451485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 838/1667] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:14:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:14.454945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc26c05-84fc-4711-a935-068c4956c7dd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:14.455127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3cc26c05-84fc-4711-a935-068c4956c7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:14.461793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 830/1668] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:14 2022] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:14.466623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20204795-b63a-4c0a-8607-4723165080c1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:14.478955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc26c05-84fc-4711-a935-068c4956c7dd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:14.600878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5867a0c-7519-464d-b9a6-1bb8299d618a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:14.601762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5867a0c-7519-464d-b9a6-1bb8299d618a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:14.602058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5867a0c-7519-464d-b9a6-1bb8299d618a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:14.602382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5867a0c-7519-464d-b9a6-1bb8299d618a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:14.652286 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20204795-b63a-4c0a-8607-4723165080c1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:14.674559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c138a54-a741-4822-a66d-e531f4ce7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:14.677341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c138a54-a741-4822-a66d-e531f4ce7466 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:14.677493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c138a54-a741-4822-a66d-e531f4ce7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:14.677769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c138a54-a741-4822-a66d-e531f4ce7466 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:14.678492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c138a54-a741-4822-a66d-e531f4ce7466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:14.688508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c138a54-a741-4822-a66d-e531f4ce7466 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:14.796046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 831/1669] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:14 2022] POST /identity/v3/users => generated 295 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:14.797103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c138a54-a741-4822-a66d-e531f4ce7466 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:14.802031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4c138a54-a741-4822-a66d-e531f4ce7466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:14.804343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5867a0c-7519-464d-b9a6-1bb8299d618a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:14.810813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5867a0c-7519-464d-b9a6-1bb8299d618a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:14.816858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:14.835678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 839/1670] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:14.838127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c138a54-a741-4822-a66d-e531f4ce7466 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:14.840089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d87ff1-4e14-4318-87ad-e39e46fef247 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:14.841346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d87ff1-4e14-4318-87ad-e39e46fef247 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:14.843368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d87ff1-4e14-4318-87ad-e39e46fef247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:14.847260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e161-fc85-4e7c-8717-48063e797563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:14.848192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e161-fc85-4e7c-8717-48063e797563 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:14.848485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e161-fc85-4e7c-8717-48063e797563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:14.850029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540e161-fc85-4e7c-8717-48063e797563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:14.866292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540e161-fc85-4e7c-8717-48063e797563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:14.871397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540e161-fc85-4e7c-8717-48063e797563 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:14.897280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 832/1671] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:14.908303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e161-fc85-4e7c-8717-48063e797563 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:14.946139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-70d87ff1-4e14-4318-87ad-e39e46fef247 None None] MFA Rules not processed for user `4174d5226c454de9bd67dbce1aade939`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:14.947400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-70d87ff1-4e14-4318-87ad-e39e46fef247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:14.953031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540e161-fc85-4e7c-8717-48063e797563 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:14.974036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e15a11-7648-4dfd-bf05-67116d9a4b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:14.976446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e15a11-7648-4dfd-bf05-67116d9a4b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:14.976915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e15a11-7648-4dfd-bf05-67116d9a4b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:14.977205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e15a11-7648-4dfd-bf05-67116d9a4b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:14.978156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e15a11-7648-4dfd-bf05-67116d9a4b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:14.984831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e15a11-7648-4dfd-bf05-67116d9a4b4d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:15.014340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 833/1672] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:15.018384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e15a11-7648-4dfd-bf05-67116d9a4b4d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:15.058522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e15a11-7648-4dfd-bf05-67116d9a4b4d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:15.075824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032598be-6ab0-410c-adab-cb5226049f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:15.076815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032598be-6ab0-410c-adab-cb5226049f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:15.077080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032598be-6ab0-410c-adab-cb5226049f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:15.077356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032598be-6ab0-410c-adab-cb5226049f22 admin admin] PATH_INFO: `/v3/projects/127a19988a7c4ec69a5103b84ebbe3cb/users/3cca2a88973244018d20dc4f2c7de641/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:15.142312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032598be-6ab0-410c-adab-cb5226049f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127a19988a7c4ec69a5103b84ebbe3cb, user_id=3cca2a88973244018d20dc4f2c7de641, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:15.153649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032598be-6ab0-410c-adab-cb5226049f22 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:15.176964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 840/1673] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:15.210923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d87ff1-4e14-4318-87ad-e39e46fef247 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:15.213542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-70d87ff1-4e14-4318-87ad-e39e46fef247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:15.217554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:15.303415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 834/1674] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:15 2022] PUT /identity/v3/projects/127a19988a7c4ec69a5103b84ebbe3cb/users/3cca2a88973244018d20dc4f2c7de641/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:15.308041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032598be-6ab0-410c-adab-cb5226049f22 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:15.452200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d87ff1-4e14-4318-87ad-e39e46fef247 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:15.501384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:15.567644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032598be-6ab0-410c-adab-cb5226049f22 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:15.587573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3f3a-0728-4712-937f-6818669f54e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:15.589686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3f3a-0728-4712-937f-6818669f54e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:15.599920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3f3a-0728-4712-937f-6818669f54e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:15.600393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3f3a-0728-4712-937f-6818669f54e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:15.601210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3f3a-0728-4712-937f-6818669f54e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:15.604121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc3f3a-0728-4712-937f-6818669f54e0 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:15.635651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 835/1675] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:15.643693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3f3a-0728-4712-937f-6818669f54e0 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:15.671345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3f3a-0728-4712-937f-6818669f54e0 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:15.677992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115b8c7-f209-4da2-af9e-2970864c571a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:15.679834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b8c7-f209-4da2-af9e-2970864c571a service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:15.684763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b8c7-f209-4da2-af9e-2970864c571a service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:15.684763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115b8c7-f209-4da2-af9e-2970864c571a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:15.690478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ae03f-6abc-4b75-8cb8-99e48a37e4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:15.691901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ae03f-6abc-4b75-8cb8-99e48a37e4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:15.696071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ae03f-6abc-4b75-8cb8-99e48a37e4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:15.696377 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ae03f-6abc-4b75-8cb8-99e48a37e4e6 admin admin] PATH_INFO: `/v3/projects/127a19988a7c4ec69a5103b84ebbe3cb/users/3cca2a88973244018d20dc4f2c7de641/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:15.705317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ae03f-6abc-4b75-8cb8-99e48a37e4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127a19988a7c4ec69a5103b84ebbe3cb, user_id=3cca2a88973244018d20dc4f2c7de641, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:15.723100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ae03f-6abc-4b75-8cb8-99e48a37e4e6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:15.761354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 836/1676] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:15 2022] PUT /identity/v3/projects/127a19988a7c4ec69a5103b84ebbe3cb/users/3cca2a88973244018d20dc4f2c7de641/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:15.771509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590c265-5591-4d1b-8048-96fa80d3f606 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:15.771789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590c265-5591-4d1b-8048-96fa80d3f606 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:15.772107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590c265-5591-4d1b-8048-96fa80d3f606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:15.810570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:15.846793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8590c265-5591-4d1b-8048-96fa80d3f606 None None] MFA Rules not processed for user `3cca2a88973244018d20dc4f2c7de641`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:15.847021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115b8c7-f209-4da2-af9e-2970864c571a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:15.848453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8590c265-5591-4d1b-8048-96fa80d3f606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:15.848588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115b8c7-f209-4da2-af9e-2970864c571a service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:15.881564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 841/1677] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:16.158574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115b8c7-f209-4da2-af9e-2970864c571a service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:16.160123 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2115b8c7-f209-4da2-af9e-2970864c571a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:16.199483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 837/1678] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:16.213223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590c265-5591-4d1b-8048-96fa80d3f606 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:16.215629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8590c265-5591-4d1b-8048-96fa80d3f606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:16.220790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115b8c7-f209-4da2-af9e-2970864c571a service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:16.348233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590c265-5591-4d1b-8048-96fa80d3f606 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:16.357736 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7864c8-13c2-477b-9e5e-3c9d50dda957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:16.358598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7864c8-13c2-477b-9e5e-3c9d50dda957 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:16.358939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7864c8-13c2-477b-9e5e-3c9d50dda957 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:16.359286 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7864c8-13c2-477b-9e5e-3c9d50dda957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:16.420990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:16.421638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:16.423364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:16.423723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] PATH_INFO: `/v3/projects/03145eab0cf34b7aa5e547e19e797cd7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:16.426835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03145eab0cf34b7aa5e547e19e797cd7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:16.432748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:16.489062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:16.540506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7864c8-13c2-477b-9e5e-3c9d50dda957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:16.552608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7864c8-13c2-477b-9e5e-3c9d50dda957 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:16.579545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 838/1679] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:16.585449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aaa7d-afd6-48f0-b12a-547c8d93fefc None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:16.586659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aaa7d-afd6-48f0-b12a-547c8d93fefc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:16.589101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aaa7d-afd6-48f0-b12a-547c8d93fefc None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:16.597721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 839/1680] 10.222.0.49 () {54 vars in 960 bytes} [Tue Jun 28 12:14:16 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:16.600062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f043-9913-48f9-9687-1cc051af11a4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:16.600690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f043-9913-48f9-9687-1cc051af11a4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:16.601130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f043-9913-48f9-9687-1cc051af11a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:16.670596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03145eab0cf34b7aa5e547e19e797cd7', 'request_id': 'req-c33333da-9e9f-4515-89f7-9c2c873a6915'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:16.676479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-18d4f043-9913-48f9-9687-1cc051af11a4 None None] MFA Rules not processed for user `c7db581dec064fe0afeb4be5838470bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:16.681960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-18d4f043-9913-48f9-9687-1cc051af11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:16.791974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03145eab0cf34b7aa5e547e19e797cd7', 'request_id': 'req-c33333da-9e9f-4515-89f7-9c2c873a6915'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:16.805868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03145eab0cf34b7aa5e547e19e797cd7', 'request_id': 'req-c33333da-9e9f-4515-89f7-9c2c873a6915'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:16.838212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] The token cache is being invalidate because project 03145eab0cf34b7aa5e547e19e797cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:16.838212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:16.841937 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:16.846944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 842/1681] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:16 2022] DELETE /identity/v3/projects/03145eab0cf34b7aa5e547e19e797cd7 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:16.850507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:16.862944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:16.898936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 840/1682] 10.222.0.49 () {58 vars in 1057 bytes} [Tue Jun 28 12:14:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:16.901989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f043-9913-48f9-9687-1cc051af11a4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:16.906371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-18d4f043-9913-48f9-9687-1cc051af11a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:17.015758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:17.023286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33333da-9e9f-4515-89f7-9c2c873a6915 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:17.034720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:17.039908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:17.039908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:17.046969 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] PATH_INFO: `/v3/users/a2dc1429c582435ca2afaede4bc22b49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:17.052689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2dc1429c582435ca2afaede4bc22b49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:17.054732 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:17.117004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f043-9913-48f9-9687-1cc051af11a4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:17.123940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:17.128272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:17.128272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:17.128272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] PATH_INFO: `/v3/projects/bb5588c2905e4d01b412db65b391ff8e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:17.128272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5588c2905e4d01b412db65b391ff8e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:17.130381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: WARNING py.warnings [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 12:14:17.130381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: warnings.warn(msg) Jun 28 12:14:17.130381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: Jun 28 12:14:17.131689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:17.311256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5588c2905e4d01b412db65b391ff8e', 'request_id': 'req-17631b67-a4b7-43b6-adb8-344f81030619'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.359901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5588c2905e4d01b412db65b391ff8e', 'request_id': 'req-17631b67-a4b7-43b6-adb8-344f81030619'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.367202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5588c2905e4d01b412db65b391ff8e', 'request_id': 'req-17631b67-a4b7-43b6-adb8-344f81030619'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.393672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:17.451999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] The token cache is being invalidate because project bb5588c2905e4d01b412db65b391ff8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:17.451999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.451999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.456291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 841/1683] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:16 2022] DELETE /identity/v3/projects/bb5588c2905e4d01b412db65b391ff8e => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:17.456291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:17.456906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:17.630415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2dc1429c582435ca2afaede4bc22b49'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.656025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631b67-a4b7-43b6-adb8-344f81030619 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:17.660821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2dc1429c582435ca2afaede4bc22b49'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.661913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2dc1429c582435ca2afaede4bc22b49'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.665682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09f7a4-350b-40f6-823e-74756b67b92d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:17.666486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09f7a4-350b-40f6-823e-74756b67b92d service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:17.666927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09f7a4-350b-40f6-823e-74756b67b92d service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:17.667697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09f7a4-350b-40f6-823e-74756b67b92d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:17.672535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cd09f7a4-350b-40f6-823e-74756b67b92d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:17.687908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2dc1429c582435ca2afaede4bc22b49'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.710541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09f7a4-350b-40f6-823e-74756b67b92d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:17.712416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09f7a4-350b-40f6-823e-74756b67b92d service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:17.724798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 842/1684] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:17.726265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc57f2-f7bd-4aae-97fd-57c0d1a1e9f9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:17.727321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc57f2-f7bd-4aae-97fd-57c0d1a1e9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:17.727321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc57f2-f7bd-4aae-97fd-57c0d1a1e9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:17.752458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-64bc57f2-f7bd-4aae-97fd-57c0d1a1e9f9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:17.754354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-64bc57f2-f7bd-4aae-97fd-57c0d1a1e9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:17.877712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db352443-ed4c-46c6-9956-ab838e4b5062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2dc1429c582435ca2afaede4bc22b49'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:17.884658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 843/1685] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:16 2022] DELETE /identity/v3/users/a2dc1429c582435ca2afaede4bc22b49 => generated 0 bytes in 1034 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:17.890525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 843/1686] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:17.895097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c42efc-a2e3-4c14-84ea-4a8bf9965499 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:17.895550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c42efc-a2e3-4c14-84ea-4a8bf9965499 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:17.896482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c42efc-a2e3-4c14-84ea-4a8bf9965499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:17.900327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e4a3-5707-4d3a-b7b6-35db5908ee08 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:17.900618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e4a3-5707-4d3a-b7b6-35db5908ee08 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:17.900973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e4a3-5707-4d3a-b7b6-35db5908ee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:17.951511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ca04e4a3-5707-4d3a-b7b6-35db5908ee08 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:17.951511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ca04e4a3-5707-4d3a-b7b6-35db5908ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:18.002761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-88c42efc-a2e3-4c14-84ea-4a8bf9965499 None None] MFA Rules not processed for user `cc3cfbaa95774ccbb567374a99e2b25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:18.008073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88c42efc-a2e3-4c14-84ea-4a8bf9965499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:18.156100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 844/1687] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:18.158128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04e4a3-5707-4d3a-b7b6-35db5908ee08 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:18.179975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04e4a3-5707-4d3a-b7b6-35db5908ee08 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:18.202187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 844/1688] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:18.204342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15a66c-189f-4ef1-a951-8a6fe3e1325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:18.204342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15a66c-189f-4ef1-a951-8a6fe3e1325f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:18.204673 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15a66c-189f-4ef1-a951-8a6fe3e1325f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:18.204863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15a66c-189f-4ef1-a951-8a6fe3e1325f admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:18.205593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15a66c-189f-4ef1-a951-8a6fe3e1325f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:18.205902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15a66c-189f-4ef1-a951-8a6fe3e1325f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:18.208347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5db4b-6d0c-448c-a25b-75d80b335b65 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:18.208639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5db4b-6d0c-448c-a25b-75d80b335b65 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:18.208911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5db4b-6d0c-448c-a25b-75d80b335b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:18.212427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15a66c-189f-4ef1-a951-8a6fe3e1325f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:18.242249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 845/1689] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:14:18.251177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15a66c-189f-4ef1-a951-8a6fe3e1325f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:18.252741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bed5db4b-6d0c-448c-a25b-75d80b335b65 None None] MFA Rules not processed for user `cc3cfbaa95774ccbb567374a99e2b25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:18.255124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bed5db4b-6d0c-448c-a25b-75d80b335b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:18.269142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15a66c-189f-4ef1-a951-8a6fe3e1325f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:18.269709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 845/1690] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:18.283376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5db4b-6d0c-448c-a25b-75d80b335b65 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:18.284002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb9d71-4a96-4f4c-8608-3655b5963887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:18.284690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9d71-4a96-4f4c-8608-3655b5963887 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:18.284976 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9d71-4a96-4f4c-8608-3655b5963887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:18.285266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9d71-4a96-4f4c-8608-3655b5963887 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:18.285961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb9d71-4a96-4f4c-8608-3655b5963887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:18.289046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bed5db4b-6d0c-448c-a25b-75d80b335b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:18.289351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb9d71-4a96-4f4c-8608-3655b5963887 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:18.420047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5db4b-6d0c-448c-a25b-75d80b335b65 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:18.426738 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb55d-800b-404d-98c8-44cbf7742421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:18.427482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb55d-800b-404d-98c8-44cbf7742421 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:18.427838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb55d-800b-404d-98c8-44cbf7742421 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:18.428213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb55d-800b-404d-98c8-44cbf7742421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:18.437974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fb55d-800b-404d-98c8-44cbf7742421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:18.440465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fb55d-800b-404d-98c8-44cbf7742421 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:18.447193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 846/1691] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:18 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:18.450249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37386ff8-d0b6-47a7-a130-4f3e068c390e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:18.450769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37386ff8-d0b6-47a7-a130-4f3e068c390e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:18.451231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37386ff8-d0b6-47a7-a130-4f3e068c390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:18.472639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 846/1692] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:18.474475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb55d-800b-404d-98c8-44cbf7742421 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:18.488374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb55d-800b-404d-98c8-44cbf7742421 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:18.496026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:18.516685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-37386ff8-d0b6-47a7-a130-4f3e068c390e None None] MFA Rules not processed for user `41b13986fd754f0283047ddf865a19de`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:18.539097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-37386ff8-d0b6-47a7-a130-4f3e068c390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:18.554862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:18.640985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f9a8b-7bad-48e9-ac05-dcb17a361837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:18.642303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f9a8b-7bad-48e9-ac05-dcb17a361837 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:18.643189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f9a8b-7bad-48e9-ac05-dcb17a361837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:18.643683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f9a8b-7bad-48e9-ac05-dcb17a361837 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:18.646235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f9a8b-7bad-48e9-ac05-dcb17a361837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:18.648999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f9a8b-7bad-48e9-ac05-dcb17a361837 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:18.685613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 847/1693] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:18.696847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37386ff8-d0b6-47a7-a130-4f3e068c390e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:18.701183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-37386ff8-d0b6-47a7-a130-4f3e068c390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:18.758990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 847/1694] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:18 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:18.759913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f9a8b-7bad-48e9-ac05-dcb17a361837 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:18.765814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-466f9a8b-7bad-48e9-ac05-dcb17a361837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:18.820340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f9a8b-7bad-48e9-ac05-dcb17a361837 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:18.823260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37386ff8-d0b6-47a7-a130-4f3e068c390e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:18.831564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7edfc8-a7b7-45fa-918b-fc365fef1c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:18.832850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7edfc8-a7b7-45fa-918b-fc365fef1c0d service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:18.833288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7edfc8-a7b7-45fa-918b-fc365fef1c0d service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:18.833747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7edfc8-a7b7-45fa-918b-fc365fef1c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:18.844624 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:18.850484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7edfc8-a7b7-45fa-918b-fc365fef1c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:18.851139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:18.851436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:18.851719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] PATH_INFO: `/v3/projects/63fd0baf9ab245738ebed3033a141ade` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:18.863502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7edfc8-a7b7-45fa-918b-fc365fef1c0d service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:18.865357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fd0baf9ab245738ebed3033a141ade)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:18.867302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:18.900143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 848/1695] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:18.912770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7edfc8-a7b7-45fa-918b-fc365fef1c0d service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:18.963792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7edfc8-a7b7-45fa-918b-fc365fef1c0d service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:18.985219 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a036a59-8b15-49a0-a32f-fe4f63d224aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:18.987543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a036a59-8b15-49a0-a32f-fe4f63d224aa admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:18.989462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a036a59-8b15-49a0-a32f-fe4f63d224aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:18.991849 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a036a59-8b15-49a0-a32f-fe4f63d224aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:18.995557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a036a59-8b15-49a0-a32f-fe4f63d224aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:18.998619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a036a59-8b15-49a0-a32f-fe4f63d224aa admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:19.049402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 849/1696] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:19.050318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a036a59-8b15-49a0-a32f-fe4f63d224aa admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:19.074222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a036a59-8b15-49a0-a32f-fe4f63d224aa admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:19.083016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fd0baf9ab245738ebed3033a141ade', 'request_id': 'req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:19.185277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d0ac5-9129-49b0-95a6-a6bfff9f00fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:19.187360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0ac5-9129-49b0-95a6-a6bfff9f00fe admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:19.188270 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0ac5-9129-49b0-95a6-a6bfff9f00fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:19.188561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0ac5-9129-49b0-95a6-a6bfff9f00fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:19.192090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d0ac5-9129-49b0-95a6-a6bfff9f00fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:19.194292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d0ac5-9129-49b0-95a6-a6bfff9f00fe admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:19.198300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fd0baf9ab245738ebed3033a141ade', 'request_id': 'req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:19.213536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fd0baf9ab245738ebed3033a141ade', 'request_id': 'req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:19.229448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 850/1697] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:19.230429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d0ac5-9129-49b0-95a6-a6bfff9f00fe admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:19.258554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d0ac5-9129-49b0-95a6-a6bfff9f00fe admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:19.272832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc176c-0e64-4906-90c5-f99db131451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:19.276527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc176c-0e64-4906-90c5-f99db131451c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:19.277005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc176c-0e64-4906-90c5-f99db131451c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:19.278469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] The token cache is being invalidate because project 63fd0baf9ab245738ebed3033a141ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:19.279215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc176c-0e64-4906-90c5-f99db131451c admin admin] PATH_INFO: `/v3/projects/2693e49e9ea742e8b981c1dd2e0cfc07/users/0e11dd8cb5ef4345b66b8663f0187fa3/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:19.280229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:19.282985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ed996a2-e5f5-4203-8b61-0dc8ba3f6280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:19.291641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 848/1698] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:18 2022] DELETE /identity/v3/projects/63fd0baf9ab245738ebed3033a141ade => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:19.296986 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893530d-a8c4-438e-90bc-6d52f4049bb9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:19.297420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893530d-a8c4-438e-90bc-6d52f4049bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:19.299825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893530d-a8c4-438e-90bc-6d52f4049bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:19.335770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc176c-0e64-4906-90c5-f99db131451c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2693e49e9ea742e8b981c1dd2e0cfc07, user_id=0e11dd8cb5ef4345b66b8663f0187fa3, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:19.338742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc176c-0e64-4906-90c5-f99db131451c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:19.354302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d893530d-a8c4-438e-90bc-6d52f4049bb9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:19.356230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d893530d-a8c4-438e-90bc-6d52f4049bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:19.367088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 849/1699] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:19.374778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1c40e-9e5b-48b0-8120-b04f13640974 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:19.375361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1c40e-9e5b-48b0-8120-b04f13640974 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:19.375856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1c40e-9e5b-48b0-8120-b04f13640974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:19.429802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-12c1c40e-9e5b-48b0-8120-b04f13640974 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:19.432067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-12c1c40e-9e5b-48b0-8120-b04f13640974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:19.441187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 851/1700] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:19 2022] PUT /identity/v3/projects/2693e49e9ea742e8b981c1dd2e0cfc07/users/0e11dd8cb5ef4345b66b8663f0187fa3/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:19.452640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8717e-aec6-46b0-9a7f-354c8d6e1c15 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:19.452938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8717e-aec6-46b0-9a7f-354c8d6e1c15 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:19.453221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8717e-aec6-46b0-9a7f-354c8d6e1c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:19.518627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:19.528887 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-25a8717e-aec6-46b0-9a7f-354c8d6e1c15 None None] MFA Rules not processed for user `0e11dd8cb5ef4345b66b8663f0187fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:19.530271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-25a8717e-aec6-46b0-9a7f-354c8d6e1c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:19.612371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 850/1701] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:19.617890 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1c40e-9e5b-48b0-8120-b04f13640974 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:19.634161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1c40e-9e5b-48b0-8120-b04f13640974 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:19.647932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58a837-9bed-48be-91d8-7d7ca4d2203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:19.651586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58a837-9bed-48be-91d8-7d7ca4d2203f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:19.653657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58a837-9bed-48be-91d8-7d7ca4d2203f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:19.654138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58a837-9bed-48be-91d8-7d7ca4d2203f admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:19.655943 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58a837-9bed-48be-91d8-7d7ca4d2203f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:19.662954 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58a837-9bed-48be-91d8-7d7ca4d2203f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:19.665843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58a837-9bed-48be-91d8-7d7ca4d2203f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:19.691979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 851/1702] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:14:19.696045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58a837-9bed-48be-91d8-7d7ca4d2203f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:19.715699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58a837-9bed-48be-91d8-7d7ca4d2203f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:19.720169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 852/1703] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:19.725675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d43f-fda8-43d5-9879-044513c97f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:19.726431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d43f-fda8-43d5-9879-044513c97f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:19.727121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d43f-fda8-43d5-9879-044513c97f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:19.727709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d43f-fda8-43d5-9879-044513c97f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:19.730982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:19.731709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8717e-aec6-46b0-9a7f-354c8d6e1c15 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:19.734461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d43f-fda8-43d5-9879-044513c97f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:19.734461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d43f-fda8-43d5-9879-044513c97f22 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:19.734671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-25a8717e-aec6-46b0-9a7f-354c8d6e1c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:19.865876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 852/1704] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:19 2022] POST /identity/v3/projects => generated 391 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:19.870187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d43f-fda8-43d5-9879-044513c97f22 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:19.915049 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8717e-aec6-46b0-9a7f-354c8d6e1c15 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:20.056036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d43f-fda8-43d5-9879-044513c97f22 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:20.062603 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34de72-5da2-4a7d-8960-7d8bce7c0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:20.072188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34de72-5da2-4a7d-8960-7d8bce7c0d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:20.072638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34de72-5da2-4a7d-8960-7d8bce7c0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:20.072846 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34de72-5da2-4a7d-8960-7d8bce7c0d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:20.073840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34de72-5da2-4a7d-8960-7d8bce7c0d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:20.089787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34de72-5da2-4a7d-8960-7d8bce7c0d4b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:20.207752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 853/1705] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:19 2022] POST /identity/v3/users => generated 296 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:20.211294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34de72-5da2-4a7d-8960-7d8bce7c0d4b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:20.224652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34de72-5da2-4a7d-8960-7d8bce7c0d4b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:20.232040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9e003-a06d-420d-aeb6-f8ca0feb2c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:20.233252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9e003-a06d-420d-aeb6-f8ca0feb2c8d service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:20.233823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9e003-a06d-420d-aeb6-f8ca0feb2c8d service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:20.234340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9e003-a06d-420d-aeb6-f8ca0feb2c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:20.243477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcb575-c9cb-4f6f-8aeb-979c339e76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:20.272899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcb575-c9cb-4f6f-8aeb-979c339e76a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:20.275946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcb575-c9cb-4f6f-8aeb-979c339e76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:20.276308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcb575-c9cb-4f6f-8aeb-979c339e76a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:20.287725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcb575-c9cb-4f6f-8aeb-979c339e76a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:20.306012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcb575-c9cb-4f6f-8aeb-979c339e76a5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:20.322192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9e003-a06d-420d-aeb6-f8ca0feb2c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:20.324215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9e003-a06d-420d-aeb6-f8ca0feb2c8d service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:20.338570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 853/1706] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:20.341071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916cd3b-1689-4805-8415-487ddf00c6d0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:20.341773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916cd3b-1689-4805-8415-487ddf00c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:20.342365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916cd3b-1689-4805-8415-487ddf00c6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:20.350095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 854/1707] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:20.352248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcb575-c9cb-4f6f-8aeb-979c339e76a5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:20.390935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e916cd3b-1689-4805-8415-487ddf00c6d0 None None] MFA Rules not processed for user `cc3cfbaa95774ccbb567374a99e2b25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:20.414617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e916cd3b-1689-4805-8415-487ddf00c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:20.448342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcb575-c9cb-4f6f-8aeb-979c339e76a5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:20.489271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b185c-2a0b-405b-a04d-7e5e5ea23ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:20.492775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b185c-2a0b-405b-a04d-7e5e5ea23ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:20.493205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b185c-2a0b-405b-a04d-7e5e5ea23ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:20.493617 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b185c-2a0b-405b-a04d-7e5e5ea23ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:20.494637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b185c-2a0b-405b-a04d-7e5e5ea23ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:20.500402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b185c-2a0b-405b-a04d-7e5e5ea23ec3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:20.541274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:20.622249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 855/1708] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:20.641134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b185c-2a0b-405b-a04d-7e5e5ea23ec3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:20.688565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b185c-2a0b-405b-a04d-7e5e5ea23ec3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:20.728887 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4879ed9-3094-4056-9a87-11162906d46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:20.729849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879ed9-3094-4056-9a87-11162906d46e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:20.730154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879ed9-3094-4056-9a87-11162906d46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:20.730404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4879ed9-3094-4056-9a87-11162906d46e admin admin] PATH_INFO: `/v3/projects/c454b9dda30443ea85851920f7214ee7/users/17c848b0f88642da97729a63249d65e3/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:20.750298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 854/1709] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:21.035568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4879ed9-3094-4056-9a87-11162906d46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c454b9dda30443ea85851920f7214ee7, user_id=17c848b0f88642da97729a63249d65e3, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:21.035568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4879ed9-3094-4056-9a87-11162906d46e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:21.039742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916cd3b-1689-4805-8415-487ddf00c6d0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:21.039742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e916cd3b-1689-4805-8415-487ddf00c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:21.039742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916cd3b-1689-4805-8415-487ddf00c6d0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:21.051306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:21.052135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:21.052628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:21.053855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] PATH_INFO: `/v3/users/0e11dd8cb5ef4345b66b8663f0187fa3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:21.056691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e11dd8cb5ef4345b66b8663f0187fa3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:21.059422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:21.139288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 856/1710] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:20 2022] PUT /identity/v3/projects/c454b9dda30443ea85851920f7214ee7/users/17c848b0f88642da97729a63249d65e3/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:21.147771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7e4b9-5011-451b-b657-4c22c1dee381 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:21.148090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7e4b9-5011-451b-b657-4c22c1dee381 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:21.148370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7e4b9-5011-451b-b657-4c22c1dee381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:21.233031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3fc7e4b9-5011-451b-b657-4c22c1dee381 None None] MFA Rules not processed for user `17c848b0f88642da97729a63249d65e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:21.234389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3fc7e4b9-5011-451b-b657-4c22c1dee381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:21.313535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e11dd8cb5ef4345b66b8663f0187fa3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:21.333128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e11dd8cb5ef4345b66b8663f0187fa3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:21.433249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 857/1711] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:21.437767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e11dd8cb5ef4345b66b8663f0187fa3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:21.438475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e11dd8cb5ef4345b66b8663f0187fa3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:21.440752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7e4b9-5011-451b-b657-4c22c1dee381 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:21.468575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-77d016cc-37de-4b78-bed0-ae35b523c711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e11dd8cb5ef4345b66b8663f0187fa3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:21.494757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 855/1712] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:20 2022] DELETE /identity/v3/users/0e11dd8cb5ef4345b66b8663f0187fa3 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:21.496379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b8ed-dccd-41f8-84b3-7de2f6a807b9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:21.502382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b8ed-dccd-41f8-84b3-7de2f6a807b9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:21.502949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b8ed-dccd-41f8-84b3-7de2f6a807b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:21.590988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d430b8ed-dccd-41f8-84b3-7de2f6a807b9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:21.593428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d430b8ed-dccd-41f8-84b3-7de2f6a807b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:21.746576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7e4b9-5011-451b-b657-4c22c1dee381 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:21.844189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c087f2-2227-476e-b09f-b84d115392a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:21.846424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c087f2-2227-476e-b09f-b84d115392a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:21.846720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c087f2-2227-476e-b09f-b84d115392a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:21.847005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c087f2-2227-476e-b09f-b84d115392a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:21.848085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 856/1713] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:21.855271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c087f2-2227-476e-b09f-b84d115392a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:21.859012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c087f2-2227-476e-b09f-b84d115392a4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:21.870415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da79b-97d6-4473-92ef-9da5c1f4260a None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:21.870992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da79b-97d6-4473-92ef-9da5c1f4260a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:21.871545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da79b-97d6-4473-92ef-9da5c1f4260a None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:21.873950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 857/1714] 10.222.0.49 () {54 vars in 912 bytes} [Tue Jun 28 12:14:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:21.879479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579ed17-5d74-41f9-ba6c-833ac722933c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:21.881468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579ed17-5d74-41f9-ba6c-833ac722933c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:21.881468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579ed17-5d74-41f9-ba6c-833ac722933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:21.915442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a579ed17-5d74-41f9-ba6c-833ac722933c None None] MFA Rules not processed for user `3ff61c1fbdf34fa38588e4cd2cdc5398`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:21.916932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a579ed17-5d74-41f9-ba6c-833ac722933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:21.998019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 858/1715] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:21 2022] POST /identity/v3/projects => generated 393 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:21.999513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c087f2-2227-476e-b09f-b84d115392a4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:22.007143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-44c087f2-2227-476e-b09f-b84d115392a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:22.098319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 858/1716] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:14:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:22.099397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579ed17-5d74-41f9-ba6c-833ac722933c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:22.100604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a579ed17-5d74-41f9-ba6c-833ac722933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:22.124298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:22.134956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579ed17-5d74-41f9-ba6c-833ac722933c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:22.255927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c087f2-2227-476e-b09f-b84d115392a4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:22.267832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe47ad-5656-4efe-9f15-df8991521cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:22.269184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe47ad-5656-4efe-9f15-df8991521cee service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:22.269474 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe47ad-5656-4efe-9f15-df8991521cee service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:22.269756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe47ad-5656-4efe-9f15-df8991521cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:22.280713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a229ee-1bbf-4c89-b2c0-0c97d12a342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:22.281463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a229ee-1bbf-4c89-b2c0-0c97d12a342c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:22.281754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a229ee-1bbf-4c89-b2c0-0c97d12a342c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:22.282035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a229ee-1bbf-4c89-b2c0-0c97d12a342c admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:22.282758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a229ee-1bbf-4c89-b2c0-0c97d12a342c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:22.284941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a229ee-1bbf-4c89-b2c0-0c97d12a342c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:22.323708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:22.432379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe47ad-5656-4efe-9f15-df8991521cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:22.432501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 859/1717] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:22 2022] POST /identity/v3/users => generated 303 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:22.432501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a229ee-1bbf-4c89-b2c0-0c97d12a342c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:22.432632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe47ad-5656-4efe-9f15-df8991521cee service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:22.432707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c6a229ee-1bbf-4c89-b2c0-0c97d12a342c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:22.445842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 859/1718] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:22.446640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe47ad-5656-4efe-9f15-df8991521cee service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:22.450224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-acfe47ad-5656-4efe-9f15-df8991521cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:22.474874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a229ee-1bbf-4c89-b2c0-0c97d12a342c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:22.485296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ee10-4371-473a-b0b0-e7bbb7b3b6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:22.485975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ee10-4371-473a-b0b0-e7bbb7b3b6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:22.486447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ee10-4371-473a-b0b0-e7bbb7b3b6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:22.486743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ee10-4371-473a-b0b0-e7bbb7b3b6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:22.504951 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8ee10-4371-473a-b0b0-e7bbb7b3b6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:22.506492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8ee10-4371-473a-b0b0-e7bbb7b3b6a7 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:22.525788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe47ad-5656-4efe-9f15-df8991521cee service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:22.530945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e5d48-d543-430f-ad45-873e84a883b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:22.531617 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5d48-d543-430f-ad45-873e84a883b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:22.531975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5d48-d543-430f-ad45-873e84a883b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:22.532209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e5d48-d543-430f-ad45-873e84a883b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:22.534094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-059e5d48-d543-430f-ad45-873e84a883b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:22.547033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 860/1719] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:22.547033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ee10-4371-473a-b0b0-e7bbb7b3b6a7 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:22.574073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ee10-4371-473a-b0b0-e7bbb7b3b6a7 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:22.587772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065a40-2842-4929-8a98-34383e1c01f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:22.589216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065a40-2842-4929-8a98-34383e1c01f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:22.589650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065a40-2842-4929-8a98-34383e1c01f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:22.591307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a065a40-2842-4929-8a98-34383e1c01f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:22.592394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a065a40-2842-4929-8a98-34383e1c01f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:22.594236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a065a40-2842-4929-8a98-34383e1c01f7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:22.609436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 861/1720] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:22.628909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065a40-2842-4929-8a98-34383e1c01f7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:22.654961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e5d48-d543-430f-ad45-873e84a883b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:22.660745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e5d48-d543-430f-ad45-873e84a883b5 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:22.666062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a065a40-2842-4929-8a98-34383e1c01f7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:22.683435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e3acb-7741-4a61-939f-9d028259b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:22.685001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e3acb-7741-4a61-939f-9d028259b589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:22.685298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e3acb-7741-4a61-939f-9d028259b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:22.685642 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e3acb-7741-4a61-939f-9d028259b589 admin admin] PATH_INFO: `/v3/projects/8867f556e13c42749f839c919287d322/users/2e9a373dcef342b4807e62c756c10662/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:22.697698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 860/1721] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:22.734208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e3acb-7741-4a61-939f-9d028259b589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8867f556e13c42749f839c919287d322, user_id=2e9a373dcef342b4807e62c756c10662, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:22.744089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e3acb-7741-4a61-939f-9d028259b589 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:22.867452 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 862/1722] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:22 2022] PUT /identity/v3/projects/8867f556e13c42749f839c919287d322/users/2e9a373dcef342b4807e62c756c10662/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:22.870005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e5d48-d543-430f-ad45-873e84a883b5 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:22.894016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e5d48-d543-430f-ad45-873e84a883b5 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:22.982614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf157f22-6718-4926-a453-4ecc730268f7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:22.982991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf157f22-6718-4926-a453-4ecc730268f7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:22.983396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf157f22-6718-4926-a453-4ecc730268f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:23.064403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-cf157f22-6718-4926-a453-4ecc730268f7 None None] MFA Rules not processed for user `4174d5226c454de9bd67dbce1aade939`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:23.071768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cf157f22-6718-4926-a453-4ecc730268f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:23.084101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f74c68-a793-4fb8-a00d-e83608b304e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:23.087273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74c68-a793-4fb8-a00d-e83608b304e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:23.087579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74c68-a793-4fb8-a00d-e83608b304e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:23.091967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f74c68-a793-4fb8-a00d-e83608b304e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:23.094141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f74c68-a793-4fb8-a00d-e83608b304e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:23.112129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f74c68-a793-4fb8-a00d-e83608b304e8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:23.202870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 861/1723] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:23.219001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f74c68-a793-4fb8-a00d-e83608b304e8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:23.304333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f74c68-a793-4fb8-a00d-e83608b304e8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:23.338121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf2ee0-d3d1-461f-8ab8-dd10c1e3d501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:23.345988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2ee0-d3d1-461f-8ab8-dd10c1e3d501 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:23.345988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2ee0-d3d1-461f-8ab8-dd10c1e3d501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:23.345988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2ee0-d3d1-461f-8ab8-dd10c1e3d501 admin admin] PATH_INFO: `/v3/projects/8867f556e13c42749f839c919287d322/users/2e9a373dcef342b4807e62c756c10662/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:23.354408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf2ee0-d3d1-461f-8ab8-dd10c1e3d501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8867f556e13c42749f839c919287d322, user_id=2e9a373dcef342b4807e62c756c10662, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:23.367652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf2ee0-d3d1-461f-8ab8-dd10c1e3d501 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:23.446739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 862/1724] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:23 2022] PUT /identity/v3/projects/8867f556e13c42749f839c919287d322/users/2e9a373dcef342b4807e62c756c10662/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:23.447253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 863/1725] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:23.448641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a03d3a-2a89-4f77-9738-99ebe692d5fb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:23.448936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a03d3a-2a89-4f77-9738-99ebe692d5fb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:23.449216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a03d3a-2a89-4f77-9738-99ebe692d5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:23.514800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f4a03d3a-2a89-4f77-9738-99ebe692d5fb None None] MFA Rules not processed for user `2e9a373dcef342b4807e62c756c10662`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:23.516485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4a03d3a-2a89-4f77-9738-99ebe692d5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:23.706201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 863/1726] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:23.919142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:24.035650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf157f22-6718-4926-a453-4ecc730268f7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:24.212469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a03d3a-2a89-4f77-9738-99ebe692d5fb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:24.214087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4a03d3a-2a89-4f77-9738-99ebe692d5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:24.240000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf157f22-6718-4926-a453-4ecc730268f7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:24.373443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21de3-8134-4c97-9ca7-4ccf4a8a4e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:24.374454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21de3-8134-4c97-9ca7-4ccf4a8a4e67 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:24.374949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21de3-8134-4c97-9ca7-4ccf4a8a4e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:24.375456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21de3-8134-4c97-9ca7-4ccf4a8a4e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:24.411310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d21de3-8134-4c97-9ca7-4ccf4a8a4e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:24.413311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d21de3-8134-4c97-9ca7-4ccf4a8a4e67 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:24.464342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 864/1727] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:24.476770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a03d3a-2a89-4f77-9738-99ebe692d5fb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:24.502125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:24.510579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65988b7-97ff-4831-88a8-a02afb66b017 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:24.511164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65988b7-97ff-4831-88a8-a02afb66b017 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:24.513082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:24.513380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:24.513655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] PATH_INFO: `/v3/projects/2693e49e9ea742e8b981c1dd2e0cfc07` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:24.515991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65988b7-97ff-4831-88a8-a02afb66b017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:24.524690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2693e49e9ea742e8b981c1dd2e0cfc07)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:24.526648 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:24.571316 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c65988b7-97ff-4831-88a8-a02afb66b017 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:24.573016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c65988b7-97ff-4831-88a8-a02afb66b017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:24.756844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 865/1728] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:24.760053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65988b7-97ff-4831-88a8-a02afb66b017 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:24.800886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65988b7-97ff-4831-88a8-a02afb66b017 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:24.815229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc9e8e-85d7-4ed4-8cad-2c2e040634e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:24.816612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc9e8e-85d7-4ed4-8cad-2c2e040634e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:24.821102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc9e8e-85d7-4ed4-8cad-2c2e040634e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:24.821246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc9e8e-85d7-4ed4-8cad-2c2e040634e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:24.827050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-46bc9e8e-85d7-4ed4-8cad-2c2e040634e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:24.880029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2693e49e9ea742e8b981c1dd2e0cfc07', 'request_id': 'req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:24.982421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2693e49e9ea742e8b981c1dd2e0cfc07', 'request_id': 'req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:24.991550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2693e49e9ea742e8b981c1dd2e0cfc07', 'request_id': 'req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:25.009444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:25.018669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] The token cache is being invalidate because project 2693e49e9ea742e8b981c1dd2e0cfc07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:25.021050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:25.024203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d91d09f-872d-4fd7-a254-e98b42ae3e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:25.026766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 864/1729] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:24 2022] DELETE /identity/v3/projects/2693e49e9ea742e8b981c1dd2e0cfc07 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:25.031620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e64f5-2985-4fe3-9900-f08e23b1ead5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:25.032157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e64f5-2985-4fe3-9900-f08e23b1ead5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:25.032578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e64f5-2985-4fe3-9900-f08e23b1ead5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:25.054038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc9e8e-85d7-4ed4-8cad-2c2e040634e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:25.055771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc9e8e-85d7-4ed4-8cad-2c2e040634e8 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:25.076393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-566e64f5-2985-4fe3-9900-f08e23b1ead5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:25.081001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-566e64f5-2985-4fe3-9900-f08e23b1ead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:25.087605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 866/1730] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:25.200106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 865/1731] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:25.209635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b240c1-7287-4037-b424-5bfe012b881f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:25.210249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b240c1-7287-4037-b424-5bfe012b881f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:25.210539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b240c1-7287-4037-b424-5bfe012b881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:25.234076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-32b240c1-7287-4037-b424-5bfe012b881f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:25.236464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-32b240c1-7287-4037-b424-5bfe012b881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:25.246845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 867/1732] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:25.250909 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e64f5-2985-4fe3-9900-f08e23b1ead5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:25.264230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e64f5-2985-4fe3-9900-f08e23b1ead5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:25.281310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607137-ee88-46b6-924d-357705c9f906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:25.282005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607137-ee88-46b6-924d-357705c9f906 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:25.282292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607137-ee88-46b6-924d-357705c9f906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:25.282578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607137-ee88-46b6-924d-357705c9f906 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:25.283409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68607137-ee88-46b6-924d-357705c9f906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:25.283731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68607137-ee88-46b6-924d-357705c9f906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:25.285890 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68607137-ee88-46b6-924d-357705c9f906 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:25.324059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b240c1-7287-4037-b424-5bfe012b881f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:25.326234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-32b240c1-7287-4037-b424-5bfe012b881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:25.333364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 866/1733] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:14:25.336324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607137-ee88-46b6-924d-357705c9f906 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:25.360440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607137-ee88-46b6-924d-357705c9f906 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:25.377168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0327c-29f0-4d4e-82e4-c0846b540a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:25.380052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0327c-29f0-4d4e-82e4-c0846b540a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:25.380052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0327c-29f0-4d4e-82e4-c0846b540a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:25.380052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0327c-29f0-4d4e-82e4-c0846b540a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:25.381927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0327c-29f0-4d4e-82e4-c0846b540a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:25.388924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0327c-29f0-4d4e-82e4-c0846b540a57 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:25.484160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b240c1-7287-4037-b424-5bfe012b881f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:25.509890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ee23-f5ef-4609-9e68-0b0800b4f8b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:25.509890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ee23-f5ef-4609-9e68-0b0800b4f8b4 service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:25.509890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ee23-f5ef-4609-9e68-0b0800b4f8b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:25.509890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ee23-f5ef-4609-9e68-0b0800b4f8b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:25.518363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2d50ee23-f5ef-4609-9e68-0b0800b4f8b4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:25.540286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 867/1734] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:25 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:25.541925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa399755-6284-43d2-8e3a-5315798384f6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:25.543970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa399755-6284-43d2-8e3a-5315798384f6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:25.544670 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa399755-6284-43d2-8e3a-5315798384f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:25.586458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fa399755-6284-43d2-8e3a-5315798384f6 None None] MFA Rules not processed for user `41b13986fd754f0283047ddf865a19de`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:25.603797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa399755-6284-43d2-8e3a-5315798384f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:25.622543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:25.676534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50ee23-f5ef-4609-9e68-0b0800b4f8b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:25.679176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50ee23-f5ef-4609-9e68-0b0800b4f8b4 service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:25.727357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 868/1735] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:14:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 12:14:25.727357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ee23-f5ef-4609-9e68-0b0800b4f8b4 service swift] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:25.741725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ee23-f5ef-4609-9e68-0b0800b4f8b4 service swift] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:25.778299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 868/1736] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:25.861364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4a18f-f4ea-4d75-93d4-48dd63c41ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:25.862399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4a18f-f4ea-4d75-93d4-48dd63c41ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:25.864285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4a18f-f4ea-4d75-93d4-48dd63c41ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:25.864870 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4a18f-f4ea-4d75-93d4-48dd63c41ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:25.866050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4a18f-f4ea-4d75-93d4-48dd63c41ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:25.868537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4a18f-f4ea-4d75-93d4-48dd63c41ce1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:26.008830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 869/1737] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:25 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:26.010300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa399755-6284-43d2-8e3a-5315798384f6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:26.038459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa399755-6284-43d2-8e3a-5315798384f6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:26.052817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8f0fe-48b7-4065-9607-58d4a348113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:26.055199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8f0fe-48b7-4065-9607-58d4a348113e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:26.055811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8f0fe-48b7-4065-9607-58d4a348113e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:26.059355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8f0fe-48b7-4065-9607-58d4a348113e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:26.060692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8f0fe-48b7-4065-9607-58d4a348113e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:26.063785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8f0fe-48b7-4065-9607-58d4a348113e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:26.107347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 869/1738] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:26.111331 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4a18f-f4ea-4d75-93d4-48dd63c41ce1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:26.129484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4a18f-f4ea-4d75-93d4-48dd63c41ce1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:26.144194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c7a1e-2917-4689-94cd-d0fa50ea594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:26.145372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c7a1e-2917-4689-94cd-d0fa50ea594c admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:26.145864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c7a1e-2917-4689-94cd-d0fa50ea594c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:26.146340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c7a1e-2917-4689-94cd-d0fa50ea594c admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:26.147715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c7a1e-2917-4689-94cd-d0fa50ea594c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:26.149701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c7a1e-2917-4689-94cd-d0fa50ea594c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:26.181974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 870/1739] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:26.186823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8f0fe-48b7-4065-9607-58d4a348113e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:26.204809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8f0fe-48b7-4065-9607-58d4a348113e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:26.219681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137135a-85f6-4137-ba23-7c1c8b040052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:26.221143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137135a-85f6-4137-ba23-7c1c8b040052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:26.221898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137135a-85f6-4137-ba23-7c1c8b040052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:26.223102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137135a-85f6-4137-ba23-7c1c8b040052 admin admin] PATH_INFO: `/v3/projects/5012aaf361db419694ba56e6ed273e69/users/ca214f51a7c04ccdabe349568709de94/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:26.277065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137135a-85f6-4137-ba23-7c1c8b040052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5012aaf361db419694ba56e6ed273e69, user_id=ca214f51a7c04ccdabe349568709de94, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:26.282492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137135a-85f6-4137-ba23-7c1c8b040052 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:26.415800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 870/1740] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:26 2022] PUT /identity/v3/projects/5012aaf361db419694ba56e6ed273e69/users/ca214f51a7c04ccdabe349568709de94/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:26.429501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44ab83-75f3-439d-8e93-67a98eb8325a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:26.437251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44ab83-75f3-439d-8e93-67a98eb8325a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:26.437251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44ab83-75f3-439d-8e93-67a98eb8325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:26.546511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8c44ab83-75f3-439d-8e93-67a98eb8325a None None] MFA Rules not processed for user `ca214f51a7c04ccdabe349568709de94`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:26.551712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8c44ab83-75f3-439d-8e93-67a98eb8325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:26.731313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 871/1741] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:26.736295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137135a-85f6-4137-ba23-7c1c8b040052 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:26.861108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137135a-85f6-4137-ba23-7c1c8b040052 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:26.882750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238a28a-0b20-4bf4-aebc-6989c8388147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:26.883635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238a28a-0b20-4bf4-aebc-6989c8388147 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:26.884577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238a28a-0b20-4bf4-aebc-6989c8388147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:26.890456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238a28a-0b20-4bf4-aebc-6989c8388147 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:26.893982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238a28a-0b20-4bf4-aebc-6989c8388147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:26.897195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238a28a-0b20-4bf4-aebc-6989c8388147 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:27.070679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 871/1742] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:26 2022] POST /identity/v3/projects => generated 371 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:27.080564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44ab83-75f3-439d-8e93-67a98eb8325a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:27.114773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44ab83-75f3-439d-8e93-67a98eb8325a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:27.263063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdfd02-08e5-409b-9a44-2cba442d5162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:27.264204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdfd02-08e5-409b-9a44-2cba442d5162 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:27.264734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdfd02-08e5-409b-9a44-2cba442d5162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:27.273333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdfd02-08e5-409b-9a44-2cba442d5162 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:27.274570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdfd02-08e5-409b-9a44-2cba442d5162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:27.279688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbdfd02-08e5-409b-9a44-2cba442d5162 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:27.381292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:27.432516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 872/1743] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:27 2022] POST /identity/v3/users => generated 292 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:27.437407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238a28a-0b20-4bf4-aebc-6989c8388147 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:27.457976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238a28a-0b20-4bf4-aebc-6989c8388147 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:27.461666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:27.466570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd66676-dc4d-415a-a493-9becc71af084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:27.469374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd66676-dc4d-415a-a493-9becc71af084 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:27.469374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd66676-dc4d-415a-a493-9becc71af084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:27.469374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd66676-dc4d-415a-a493-9becc71af084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:27.469374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd66676-dc4d-415a-a493-9becc71af084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:27.472055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd66676-dc4d-415a-a493-9becc71af084 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:27.495927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 872/1744] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:27.498762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdfd02-08e5-409b-9a44-2cba442d5162 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:27.562094 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdfd02-08e5-409b-9a44-2cba442d5162 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:27.582077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1b112-2a56-4773-8477-830264dc9b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:27.582831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b112-2a56-4773-8477-830264dc9b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:27.583188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b112-2a56-4773-8477-830264dc9b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:27.583471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b112-2a56-4773-8477-830264dc9b08 admin admin] PATH_INFO: `/v3/projects/5005a552aa994865b67effb9f1fe5415/users/f6bcc08776564ce68f884201b55df199/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:27.634540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1b112-2a56-4773-8477-830264dc9b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5005a552aa994865b67effb9f1fe5415, user_id=f6bcc08776564ce68f884201b55df199, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:27.637339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1b112-2a56-4773-8477-830264dc9b08 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:27.775008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 873/1745] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:27 2022] PUT /identity/v3/projects/5005a552aa994865b67effb9f1fe5415/users/f6bcc08776564ce68f884201b55df199/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:27.780712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd66676-dc4d-415a-a493-9becc71af084 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:27.816410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd66676-dc4d-415a-a493-9becc71af084 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:28.085925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49f746-aab4-4747-bde1-9443bc5dccfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:28.086638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f746-aab4-4747-bde1-9443bc5dccfc admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:28.086922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f746-aab4-4747-bde1-9443bc5dccfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:28.093405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49f746-aab4-4747-bde1-9443bc5dccfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:28.093405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49f746-aab4-4747-bde1-9443bc5dccfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:28.093405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49f746-aab4-4747-bde1-9443bc5dccfc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:28.158413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 873/1746] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:28.161749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1b112-2a56-4773-8477-830264dc9b08 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:28.194240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1b112-2a56-4773-8477-830264dc9b08 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:28.210527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ec34-05de-4131-b7bb-6573fe714f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:28.217097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ec34-05de-4131-b7bb-6573fe714f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:28.218522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ec34-05de-4131-b7bb-6573fe714f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:28.218798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321ec34-05de-4131-b7bb-6573fe714f10 admin admin] PATH_INFO: `/v3/projects/5005a552aa994865b67effb9f1fe5415/users/f6bcc08776564ce68f884201b55df199/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:28.228660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ec34-05de-4131-b7bb-6573fe714f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5005a552aa994865b67effb9f1fe5415, user_id=f6bcc08776564ce68f884201b55df199, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:28.235804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321ec34-05de-4131-b7bb-6573fe714f10 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:28.266737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 874/1747] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:28 2022] PUT /identity/v3/projects/5005a552aa994865b67effb9f1fe5415/users/f6bcc08776564ce68f884201b55df199/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:28.280163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e976441-c590-4d40-a343-eeab3b2f9af6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:28.280579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e976441-c590-4d40-a343-eeab3b2f9af6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:28.280896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e976441-c590-4d40-a343-eeab3b2f9af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:28.399450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6e976441-c590-4d40-a343-eeab3b2f9af6 None None] MFA Rules not processed for user `f6bcc08776564ce68f884201b55df199`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:28.401491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e976441-c590-4d40-a343-eeab3b2f9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:28.738897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 874/1748] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:28.741142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:28.801374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ec34-05de-4131-b7bb-6573fe714f10 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:28.803087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9321ec34-05de-4131-b7bb-6573fe714f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:29.027558 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321ec34-05de-4131-b7bb-6573fe714f10 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:29.049414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12cd5d-0d58-44bf-a17f-e48ae1fbd746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:29.050400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12cd5d-0d58-44bf-a17f-e48ae1fbd746 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:29.050824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12cd5d-0d58-44bf-a17f-e48ae1fbd746 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:29.051249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12cd5d-0d58-44bf-a17f-e48ae1fbd746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:29.084327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:29.093997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12cd5d-0d58-44bf-a17f-e48ae1fbd746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:29.095583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12cd5d-0d58-44bf-a17f-e48ae1fbd746 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:29.110202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:29.133569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 875/1749] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:30.232470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe5a8-e7d6-4624-9756-c16ffab73b0e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:30.232946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe5a8-e7d6-4624-9756-c16ffab73b0e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:30.233041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffe5a8-e7d6-4624-9756-c16ffab73b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:30.309023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f5ffe5a8-e7d6-4624-9756-c16ffab73b0e None None] MFA Rules not processed for user `3ff61c1fbdf34fa38588e4cd2cdc5398`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:30.313794 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f5ffe5a8-e7d6-4624-9756-c16ffab73b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:30.557532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:30.572631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 875/1750] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Jun 28 12:14:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:30.588407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12cd5d-0d58-44bf-a17f-e48ae1fbd746 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:30.590621 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7f12cd5d-0d58-44bf-a17f-e48ae1fbd746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:30.634726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12cd5d-0d58-44bf-a17f-e48ae1fbd746 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:30.672823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dc91a-b25a-423f-92db-740154fc4a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:30.672823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dc91a-b25a-423f-92db-740154fc4a59 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:30.672823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dc91a-b25a-423f-92db-740154fc4a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:30.672823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dc91a-b25a-423f-92db-740154fc4a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:30.680635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe5a8-e7d6-4624-9756-c16ffab73b0e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:30.692538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffe5a8-e7d6-4624-9756-c16ffab73b0e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:30.697009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dc91a-b25a-423f-92db-740154fc4a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:30.701296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dc91a-b25a-423f-92db-740154fc4a59 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:30.712859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c7ac8-e7c1-415f-af5b-1db670e55ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:30.712859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c7ac8-e7c1-415f-af5b-1db670e55ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:30.712859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c7ac8-e7c1-415f-af5b-1db670e55ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:30.712859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c7ac8-e7c1-415f-af5b-1db670e55ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:30.736021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 876/1751] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:30.739828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c7ac8-e7c1-415f-af5b-1db670e55ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:30.742660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c7ac8-e7c1-415f-af5b-1db670e55ca8 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:30.785413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 876/1752] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:32.593070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dc91a-b25a-423f-92db-740154fc4a59 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:32.786275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dc91a-b25a-423f-92db-740154fc4a59 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:32.793571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:32.796055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:32.796467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:32.796879 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] PATH_INFO: `/v3/users/ca214f51a7c04ccdabe349568709de94` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:32.798679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca214f51a7c04ccdabe349568709de94)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:32.800830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:33.085832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca214f51a7c04ccdabe349568709de94'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:33.112668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca214f51a7c04ccdabe349568709de94'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:33.201409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca214f51a7c04ccdabe349568709de94'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:33.208373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca214f51a7c04ccdabe349568709de94'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:33.247147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:33.251596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca214f51a7c04ccdabe349568709de94'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:33.294225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 877/1753] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:32 2022] DELETE /identity/v3/users/ca214f51a7c04ccdabe349568709de94 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:33.295813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fa446-d943-4f00-a640-e3da840cd22e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:33.296346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fa446-d943-4f00-a640-e3da840cd22e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:33.296561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fa446-d943-4f00-a640-e3da840cd22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:33.350363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e16fa446-d943-4f00-a640-e3da840cd22e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:33.350363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e16fa446-d943-4f00-a640-e3da840cd22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:33.471924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 877/1754] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:33.611904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:33.614664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:33.799263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8a68d-85ab-4777-bcd9-ef51dd961d7f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:33.809480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce22dd-f888-492a-9413-2c3ec721327f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:33.812161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce22dd-f888-492a-9413-2c3ec721327f service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:33.814480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce22dd-f888-492a-9413-2c3ec721327f service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:33.814933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce22dd-f888-492a-9413-2c3ec721327f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:33.875708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce22dd-f888-492a-9413-2c3ec721327f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:33.878668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce22dd-f888-492a-9413-2c3ec721327f service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:33.905059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 878/1755] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:34.515541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df481aa0-fa3f-41d9-942b-555444016d35 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:34.516848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df481aa0-fa3f-41d9-942b-555444016d35 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:34.517449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df481aa0-fa3f-41d9-942b-555444016d35 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:34.532087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 878/1756] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:14:34 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:34.670239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce22dd-f888-492a-9413-2c3ec721327f service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:34.673671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9bce22dd-f888-492a-9413-2c3ec721327f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:34.709347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c6aa3-75c3-4ad3-a5c4-9e21e90c85f8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:34.709895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c6aa3-75c3-4ad3-a5c4-9e21e90c85f8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:34.709895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c6aa3-75c3-4ad3-a5c4-9e21e90c85f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:34.740413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce22dd-f888-492a-9413-2c3ec721327f service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:34.747722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-228c6aa3-75c3-4ad3-a5c4-9e21e90c85f8 None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:34.749610 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-228c6aa3-75c3-4ad3-a5c4-9e21e90c85f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:34.765962 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:34.767575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:34.769915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:34.770404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] PATH_INFO: `/v3/users/17c848b0f88642da97729a63249d65e3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:34.773225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c848b0f88642da97729a63249d65e3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:34.780178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:34.892148 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 879/1757] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:14:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:34.958084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c6aa3-75c3-4ad3-a5c4-9e21e90c85f8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:34.959662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-228c6aa3-75c3-4ad3-a5c4-9e21e90c85f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:34.986391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c6aa3-75c3-4ad3-a5c4-9e21e90c85f8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:34.999072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5db744-b846-4d3a-8710-ebe9e4885109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:35.000474 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5db744-b846-4d3a-8710-ebe9e4885109 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:35.001324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5db744-b846-4d3a-8710-ebe9e4885109 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:35.002173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5db744-b846-4d3a-8710-ebe9e4885109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:35.015172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5db744-b846-4d3a-8710-ebe9e4885109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:35.017303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5db744-b846-4d3a-8710-ebe9e4885109 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:35.044600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 880/1758] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:35.111077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5db744-b846-4d3a-8710-ebe9e4885109 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:35.111077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb5db744-b846-4d3a-8710-ebe9e4885109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:35.132061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c848b0f88642da97729a63249d65e3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.138141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5db744-b846-4d3a-8710-ebe9e4885109 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:35.168372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:35.168566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:35.169003 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:35.169719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] PATH_INFO: `/v3/users/cb05d53d98c545688579fe10a88ed726` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:35.176660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c848b0f88642da97729a63249d65e3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.178137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb05d53d98c545688579fe10a88ed726)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:35.201415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:35.274810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c848b0f88642da97729a63249d65e3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.289731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c848b0f88642da97729a63249d65e3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.415256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6f0e125d-90da-44e3-9fdb-be73a2b0334b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c848b0f88642da97729a63249d65e3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.448494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 879/1759] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:34 2022] DELETE /identity/v3/users/17c848b0f88642da97729a63249d65e3 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:35.451334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3177f-aaf6-43c9-87e7-be118e5ae93b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:35.456506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3177f-aaf6-43c9-87e7-be118e5ae93b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:35.456822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3177f-aaf6-43c9-87e7-be118e5ae93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:35.497841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb05d53d98c545688579fe10a88ed726'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.518626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb05d53d98c545688579fe10a88ed726'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.521849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb05d53d98c545688579fe10a88ed726'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.529601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-76e3177f-aaf6-43c9-87e7-be118e5ae93b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:35.530761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-76e3177f-aaf6-43c9-87e7-be118e5ae93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:35.530915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:35.557341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb05d53d98c545688579fe10a88ed726'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.633472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb05d53d98c545688579fe10a88ed726'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:35.654466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 881/1760] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:35 2022] DELETE /identity/v3/users/cb05d53d98c545688579fe10a88ed726 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:35.658439 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:35.664618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:35.719293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 880/1761] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:35.723499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d369f24-d188-40a8-8e0a-c4cba9c1b4d7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:35.726479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d369f24-d188-40a8-8e0a-c4cba9c1b4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:35.727103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d369f24-d188-40a8-8e0a-c4cba9c1b4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:35.779723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7d369f24-d188-40a8-8e0a-c4cba9c1b4d7 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:35.791966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7d369f24-d188-40a8-8e0a-c4cba9c1b4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:35.799823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:35.860743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d0dca-6a37-4bd9-b4ad-e20f557734bd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:35.883032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:35.884643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:35.885043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:35.885496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] PATH_INFO: `/v3/projects/5012aaf361db419694ba56e6ed273e69` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:35.892104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5012aaf361db419694ba56e6ed273e69)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:35.894393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:35.937138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 881/1762] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:35.941441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada96b38-bc56-4935-83a8-af0611802c67 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:35.942117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada96b38-bc56-4935-83a8-af0611802c67 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:35.942417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada96b38-bc56-4935-83a8-af0611802c67 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:35.944619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 882/1763] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:14:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:35.945807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada96b38-bc56-4935-83a8-af0611802c67 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:35.947791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ada96b38-bc56-4935-83a8-af0611802c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:36.143512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada96b38-bc56-4935-83a8-af0611802c67 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:36.157628 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5012aaf361db419694ba56e6ed273e69', 'request_id': 'req-644076b5-88d8-412f-a813-94100f8223c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:36.225912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5012aaf361db419694ba56e6ed273e69', 'request_id': 'req-644076b5-88d8-412f-a813-94100f8223c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:36.236571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5012aaf361db419694ba56e6ed273e69', 'request_id': 'req-644076b5-88d8-412f-a813-94100f8223c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:36.268165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3510c07-14d9-47eb-8119-a22838d6d329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:36.272859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3510c07-14d9-47eb-8119-a22838d6d329 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:36.273153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3510c07-14d9-47eb-8119-a22838d6d329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:36.273433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3510c07-14d9-47eb-8119-a22838d6d329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:36.276011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] The token cache is being invalidate because project 5012aaf361db419694ba56e6ed273e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:36.276386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:36.279391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:36.286053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 882/1764] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:35 2022] DELETE /identity/v3/projects/5012aaf361db419694ba56e6ed273e69 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:36.286650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:36.294558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:36.337872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644076b5-88d8-412f-a813-94100f8223c8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:36.343295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:36.344211 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:36.344901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:36.345143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:36.368645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:36.453165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3510c07-14d9-47eb-8119-a22838d6d329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:36.456300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3510c07-14d9-47eb-8119-a22838d6d329 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:36.481176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 883/1765] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:36.482983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c768161-bcc8-4ccd-b43b-19fc8d0bb2a4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:36.484191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c768161-bcc8-4ccd-b43b-19fc8d0bb2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:36.484705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c768161-bcc8-4ccd-b43b-19fc8d0bb2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:36.542692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:36.545476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:36.547332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6c768161-bcc8-4ccd-b43b-19fc8d0bb2a4 None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:36.553522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:36.555269 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6c768161-bcc8-4ccd-b43b-19fc8d0bb2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:36.562000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 883/1766] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:36.570165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:36.570165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:36.583303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b3655-b388-4343-83be-065a76ab0098 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:36.585313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:36.591830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:36.593139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:36.593603 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:36.594030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] PATH_INFO: `/v3/users/f6bcc08776564ce68f884201b55df199` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:36.595475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6bcc08776564ce68f884201b55df199)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:36.597653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:36.718196 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 884/1767] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:14:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:36.852829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c768161-bcc8-4ccd-b43b-19fc8d0bb2a4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:36.855379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6c768161-bcc8-4ccd-b43b-19fc8d0bb2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:36.856226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6bcc08776564ce68f884201b55df199'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:36.887549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c768161-bcc8-4ccd-b43b-19fc8d0bb2a4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:36.894837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6bcc08776564ce68f884201b55df199'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:36.896278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6bcc08776564ce68f884201b55df199'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:36.906467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f23181-ec9a-4f16-8915-0f4c777b9b25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:36.907479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f23181-ec9a-4f16-8915-0f4c777b9b25 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:36.916289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f23181-ec9a-4f16-8915-0f4c777b9b25 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:36.916971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f23181-ec9a-4f16-8915-0f4c777b9b25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:36.941162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6bcc08776564ce68f884201b55df199'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:36.943462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f23181-ec9a-4f16-8915-0f4c777b9b25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:36.946510 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f23181-ec9a-4f16-8915-0f4c777b9b25 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:36.971159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 885/1768] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:37.008769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6bcc08776564ce68f884201b55df199'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:37.019500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 884/1769] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:36 2022] DELETE /identity/v3/users/f6bcc08776564ce68f884201b55df199 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:38.729669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f23181-ec9a-4f16-8915-0f4c777b9b25 service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:38.732780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-84f23181-ec9a-4f16-8915-0f4c777b9b25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:38.749246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:38.753691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:38.761125 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f23181-ec9a-4f16-8915-0f4c777b9b25 service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:38.938378 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:38.941705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:38.941997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:38.942357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] PATH_INFO: `/v3/projects/c454b9dda30443ea85851920f7214ee7` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:38.944482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c454b9dda30443ea85851920f7214ee7)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:38.945970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19649ae8-3c60-4211-960f-82573a218359 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:38.946849 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:38.952677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:38.953767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:38.954124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:38.954529 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] PATH_INFO: `/v3/projects/4b3456aa114f4c4391f9f49850a44c60` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:38.959759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3456aa114f4c4391f9f49850a44c60)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:38.961882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:39.108977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c454b9dda30443ea85851920f7214ee7', 'request_id': 'req-a8ca267d-790e-4a70-8848-74fccfb5e038'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.126282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c454b9dda30443ea85851920f7214ee7', 'request_id': 'req-a8ca267d-790e-4a70-8848-74fccfb5e038'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.148415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3456aa114f4c4391f9f49850a44c60', 'request_id': 'req-b499f734-7fc9-4200-b637-8e69d33ee840'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.148643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c454b9dda30443ea85851920f7214ee7', 'request_id': 'req-a8ca267d-790e-4a70-8848-74fccfb5e038'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.248434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3456aa114f4c4391f9f49850a44c60', 'request_id': 'req-b499f734-7fc9-4200-b637-8e69d33ee840'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.255686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3456aa114f4c4391f9f49850a44c60', 'request_id': 'req-b499f734-7fc9-4200-b637-8e69d33ee840'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.271863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] The token cache is being invalidate because project 4b3456aa114f4c4391f9f49850a44c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:39.272449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.273742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.279830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 885/1770] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:38 2022] DELETE /identity/v3/projects/4b3456aa114f4c4391f9f49850a44c60 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:39.279830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:39.281418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:39.286779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:39.315537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] The token cache is being invalidate because project c454b9dda30443ea85851920f7214ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:39.316027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.317680 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.322696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 886/1771] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:38 2022] DELETE /identity/v3/projects/c454b9dda30443ea85851920f7214ee7 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:39.324967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:39.329513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:39.389035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499f734-7fc9-4200-b637-8e69d33ee840 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:39.394352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:39.395520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:39.395520 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:39.396129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] PATH_INFO: `/v3/projects/5005a552aa994865b67effb9f1fe5415` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:39.397241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5005a552aa994865b67effb9f1fe5415)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:39.397856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:39.399107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:39.445216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca267d-790e-4a70-8848-74fccfb5e038 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:39.450583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:39.451498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:39.451780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:39.452241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] PATH_INFO: `/v3/users/b4669dd1e67d4326a061af77981cd199` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:39.453400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4669dd1e67d4326a061af77981cd199)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:39.455330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:39.549256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5005a552aa994865b67effb9f1fe5415', 'request_id': 'req-0b4becc4-64f1-4fdc-9efa-393bb768a891'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.625346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5005a552aa994865b67effb9f1fe5415', 'request_id': 'req-0b4becc4-64f1-4fdc-9efa-393bb768a891'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.633182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5005a552aa994865b67effb9f1fe5415', 'request_id': 'req-0b4becc4-64f1-4fdc-9efa-393bb768a891'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.649046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] The token cache is being invalidate because project 5005a552aa994865b67effb9f1fe5415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:39.649597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.650661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.657063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 886/1772] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:39 2022] DELETE /identity/v3/projects/5005a552aa994865b67effb9f1fe5415 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:39.657063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:39.657580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:39.707996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4669dd1e67d4326a061af77981cd199'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.733353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4669dd1e67d4326a061af77981cd199'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.768293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4becc4-64f1-4fdc-9efa-393bb768a891 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:39.776579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:39.778953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:39.779263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:39.779554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] PATH_INFO: `/v3/users/2e9a373dcef342b4807e62c756c10662` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:39.780893 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9a373dcef342b4807e62c756c10662)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:39.783157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:39.785199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4669dd1e67d4326a061af77981cd199'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.786007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4669dd1e67d4326a061af77981cd199'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.826889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ada2ddca-48a8-40c7-a44d-d49e4cf24974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4669dd1e67d4326a061af77981cd199'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:39.837552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 887/1773] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:39 2022] DELETE /identity/v3/users/b4669dd1e67d4326a061af77981cd199 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:39.839830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7f79-1b0f-4ecb-9c7e-47d3518a908f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:39.843550 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7f79-1b0f-4ecb-9c7e-47d3518a908f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:39.844185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7f79-1b0f-4ecb-9c7e-47d3518a908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:39.866640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ec4b7f79-1b0f-4ecb-9c7e-47d3518a908f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:39.867993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ec4b7f79-1b0f-4ecb-9c7e-47d3518a908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:39.975357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 888/1774] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:39.984177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0344f3-caad-47b3-9e45-666acbf294bd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:39.984763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0344f3-caad-47b3-9e45-666acbf294bd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:39.985231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0344f3-caad-47b3-9e45-666acbf294bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:40.010080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ae0344f3-caad-47b3-9e45-666acbf294bd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:40.012491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ae0344f3-caad-47b3-9e45-666acbf294bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:40.038713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 889/1775] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:40.038802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9a373dcef342b4807e62c756c10662'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:40.042231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0344f3-caad-47b3-9e45-666acbf294bd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:40.056015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9a373dcef342b4807e62c756c10662'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:40.056919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9a373dcef342b4807e62c756c10662'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:40.060245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0344f3-caad-47b3-9e45-666acbf294bd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:40.072210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9a373dcef342b4807e62c756c10662'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:40.077964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97f93a-b0f1-42f6-a7e4-87e69df6d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:40.078854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97f93a-b0f1-42f6-a7e4-87e69df6d5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:40.079212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97f93a-b0f1-42f6-a7e4-87e69df6d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:40.079563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97f93a-b0f1-42f6-a7e4-87e69df6d5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:40.080416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97f93a-b0f1-42f6-a7e4-87e69df6d5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:40.080799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97f93a-b0f1-42f6-a7e4-87e69df6d5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:40.082555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97f93a-b0f1-42f6-a7e4-87e69df6d5dd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:40.097018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 890/1776] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:14:40.101109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97f93a-b0f1-42f6-a7e4-87e69df6d5dd admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:40.120363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97f93a-b0f1-42f6-a7e4-87e69df6d5dd admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:40.126423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b527-2176-4876-8a97-094a0ca5d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:40.127194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b527-2176-4876-8a97-094a0ca5d6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:40.127550 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b527-2176-4876-8a97-094a0ca5d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:40.127923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b527-2176-4876-8a97-094a0ca5d6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:40.128751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2b527-2176-4876-8a97-094a0ca5d6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:40.130762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2b527-2176-4876-8a97-094a0ca5d6f5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:40.226924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9a373dcef342b4807e62c756c10662'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:40.238504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 887/1777] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:39 2022] DELETE /identity/v3/users/2e9a373dcef342b4807e62c756c10662 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:40.274064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 891/1778] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:40 2022] POST /identity/v3/projects => generated 363 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:40.278232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:40.279940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:40.432240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091993bb-8dc3-466a-a702-47d1df6c20e8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:40.525566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea148f-88bc-4da3-8d60-8a3de5abdcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:40.526437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea148f-88bc-4da3-8d60-8a3de5abdcde admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:40.526848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea148f-88bc-4da3-8d60-8a3de5abdcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:40.527275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea148f-88bc-4da3-8d60-8a3de5abdcde admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:40.528023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea148f-88bc-4da3-8d60-8a3de5abdcde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:40.530150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea148f-88bc-4da3-8d60-8a3de5abdcde admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:40.635132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 888/1779] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:40 2022] POST /identity/v3/users => generated 282 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:40.638905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b527-2176-4876-8a97-094a0ca5d6f5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:40.658864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b527-2176-4876-8a97-094a0ca5d6f5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:40.666171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6befe-c725-4249-977e-f11ecfba024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:40.668697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6befe-c725-4249-977e-f11ecfba024c admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:40.668898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6befe-c725-4249-977e-f11ecfba024c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:40.669392 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6befe-c725-4249-977e-f11ecfba024c admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:40.670203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6befe-c725-4249-977e-f11ecfba024c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:40.672358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6befe-c725-4249-977e-f11ecfba024c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:40.685709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 892/1780] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:40.690054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea148f-88bc-4da3-8d60-8a3de5abdcde admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:40.704054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea148f-88bc-4da3-8d60-8a3de5abdcde admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:40.710125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da19a-a361-4a56-b61f-0cc394c7a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:40.710812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da19a-a361-4a56-b61f-0cc394c7a45e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:40.711144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da19a-a361-4a56-b61f-0cc394c7a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:40.711513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da19a-a361-4a56-b61f-0cc394c7a45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:40.712341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da19a-a361-4a56-b61f-0cc394c7a45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:40.713951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da19a-a361-4a56-b61f-0cc394c7a45e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:40.726666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 889/1781] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:40.731625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6befe-c725-4249-977e-f11ecfba024c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:40.743012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6befe-c725-4249-977e-f11ecfba024c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:40.749087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460eec4-ae0f-4687-83ff-74b08321a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:40.750291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460eec4-ae0f-4687-83ff-74b08321a18c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:40.750649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460eec4-ae0f-4687-83ff-74b08321a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:40.750999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460eec4-ae0f-4687-83ff-74b08321a18c admin admin] PATH_INFO: `/v3/projects/5274c1feaa1547a49ffe41ddcc11845b/users/4860899cf6b64b7eb3eacbfc84fe084b/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:40.769829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460eec4-ae0f-4687-83ff-74b08321a18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5274c1feaa1547a49ffe41ddcc11845b, user_id=4860899cf6b64b7eb3eacbfc84fe084b, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:40.773724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460eec4-ae0f-4687-83ff-74b08321a18c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:40.853562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 893/1782] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:40 2022] PUT /identity/v3/projects/5274c1feaa1547a49ffe41ddcc11845b/users/4860899cf6b64b7eb3eacbfc84fe084b/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:40.865383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf85a0-b616-4ee9-a90e-a720c62b655d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:40.865909 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf85a0-b616-4ee9-a90e-a720c62b655d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:40.866112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf85a0-b616-4ee9-a90e-a720c62b655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:40.968628 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-aacf85a0-b616-4ee9-a90e-a720c62b655d None None] MFA Rules not processed for user `4860899cf6b64b7eb3eacbfc84fe084b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:40.970891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-aacf85a0-b616-4ee9-a90e-a720c62b655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:40.991422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460eec4-ae0f-4687-83ff-74b08321a18c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:40.993406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c460eec4-ae0f-4687-83ff-74b08321a18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:41.107234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 890/1783] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:41.112932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf85a0-b616-4ee9-a90e-a720c62b655d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:41.114212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460eec4-ae0f-4687-83ff-74b08321a18c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:41.119604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:41.121022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.121427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.121675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] PATH_INFO: `/v3/projects/5bdecff7262c412d9cbfe219ea4bd80b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.123213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdecff7262c412d9cbfe219ea4bd80b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:41.124945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:41.128503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf85a0-b616-4ee9-a90e-a720c62b655d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:41.138093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2cb55-8760-4199-a0b4-e705e7c21efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:41.139129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2cb55-8760-4199-a0b4-e705e7c21efe admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.139475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2cb55-8760-4199-a0b4-e705e7c21efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.142749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2cb55-8760-4199-a0b4-e705e7c21efe admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.142749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2cb55-8760-4199-a0b4-e705e7c21efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:41.143755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2cb55-8760-4199-a0b4-e705e7c21efe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:41.240650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 891/1784] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:41 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:41.241574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2cb55-8760-4199-a0b4-e705e7c21efe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:41.245894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:41.246782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7eb2cb55-8760-4199-a0b4-e705e7c21efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:41.253896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdecff7262c412d9cbfe219ea4bd80b', 'request_id': 'req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.261694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdecff7262c412d9cbfe219ea4bd80b', 'request_id': 'req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.268403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdecff7262c412d9cbfe219ea4bd80b', 'request_id': 'req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.323178 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2cb55-8760-4199-a0b4-e705e7c21efe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:41.328532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:41.329578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.329864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.330142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] PATH_INFO: `/v3/projects/8867f556e13c42749f839c919287d322` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.331499 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8867f556e13c42749f839c919287d322)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:41.333511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:41.363615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] The token cache is being invalidate because project 5bdecff7262c412d9cbfe219ea4bd80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:41.363615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.364531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.369638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 894/1785] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:40 2022] DELETE /identity/v3/projects/5bdecff7262c412d9cbfe219ea4bd80b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:41.369638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:41.369638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:41.453193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8867f556e13c42749f839c919287d322', 'request_id': 'req-62ecb03e-2fa8-45d1-8c09-6517fe931f62'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.469840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3cca1-a2aa-47b1-b50a-e46d8afeb737 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:41.520511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:41.563139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8867f556e13c42749f839c919287d322', 'request_id': 'req-62ecb03e-2fa8-45d1-8c09-6517fe931f62'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.571317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8867f556e13c42749f839c919287d322', 'request_id': 'req-62ecb03e-2fa8-45d1-8c09-6517fe931f62'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.571517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f60b7a-6df4-49b2-b902-dfe6925d4623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:41.572332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f60b7a-6df4-49b2-b902-dfe6925d4623 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.572885 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f60b7a-6df4-49b2-b902-dfe6925d4623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.573529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f60b7a-6df4-49b2-b902-dfe6925d4623 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.575097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f60b7a-6df4-49b2-b902-dfe6925d4623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:41.577426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f60b7a-6df4-49b2-b902-dfe6925d4623 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:41.584205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] The token cache is being invalidate because project 8867f556e13c42749f839c919287d322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:41.584775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.585472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-62ecb03e-2fa8-45d1-8c09-6517fe931f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:41.591404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 892/1786] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:41 2022] DELETE /identity/v3/projects/8867f556e13c42749f839c919287d322 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:41.591404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d4ca-98d5-4f9b-9d58-aa54605a527c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.591404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d4ca-98d5-4f9b-9d58-aa54605a527c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.591404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4d4ca-98d5-4f9b-9d58-aa54605a527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.612131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e4c4d4ca-98d5-4f9b-9d58-aa54605a527c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:41.613433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e4c4d4ca-98d5-4f9b-9d58-aa54605a527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:41.622469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 893/1787] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:41.623759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927a63-2d16-4506-9489-5a47bbd73296 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.624079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927a63-2d16-4506-9489-5a47bbd73296 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.624358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65927a63-2d16-4506-9489-5a47bbd73296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.646095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-65927a63-2d16-4506-9489-5a47bbd73296 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:41.647333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-65927a63-2d16-4506-9489-5a47bbd73296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:41.660489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 894/1788] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:41.661795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cbffb-1bda-4a73-a6b3-6e8ed0e20c0d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.662080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cbffb-1bda-4a73-a6b3-6e8ed0e20c0d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.662383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cbffb-1bda-4a73-a6b3-6e8ed0e20c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.683585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2e7cbffb-1bda-4a73-a6b3-6e8ed0e20c0d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:41.684321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2e7cbffb-1bda-4a73-a6b3-6e8ed0e20c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:41.695052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 895/1789] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:41.696396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394c3c-a301-410b-8e37-68016b58d56f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.696676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394c3c-a301-410b-8e37-68016b58d56f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.696957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394c3c-a301-410b-8e37-68016b58d56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.712718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 895/1790] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:41 2022] POST /identity/v3/users => generated 288 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:41.713789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f60b7a-6df4-49b2-b902-dfe6925d4623 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:41.719648 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1e394c3c-a301-410b-8e37-68016b58d56f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:41.720983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1e394c3c-a301-410b-8e37-68016b58d56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:41.729493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 896/1791] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:41.731031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e394c3c-a301-410b-8e37-68016b58d56f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:41.732136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f60b7a-6df4-49b2-b902-dfe6925d4623 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:41.732266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1e394c3c-a301-410b-8e37-68016b58d56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:41.737652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5f04a-6337-40d1-955a-66f293dd6f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:41.738484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5f04a-6337-40d1-955a-66f293dd6f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.738845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5f04a-6337-40d1-955a-66f293dd6f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.739457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5f04a-6337-40d1-955a-66f293dd6f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.740389 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5f04a-6337-40d1-955a-66f293dd6f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:41.740778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5f04a-6337-40d1-955a-66f293dd6f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:41.743426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5f04a-6337-40d1-955a-66f293dd6f33 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:41.744677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e394c3c-a301-410b-8e37-68016b58d56f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:41.751681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc2ab4-b4f7-42fb-a769-d98b4bc5eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:41.752562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2ab4-b4f7-42fb-a769-d98b4bc5eeea admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.752735 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2ab4-b4f7-42fb-a769-d98b4bc5eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.753184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2ab4-b4f7-42fb-a769-d98b4bc5eeea admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.753743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc2ab4-b4f7-42fb-a769-d98b4bc5eeea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:41.755345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc2ab4-b4f7-42fb-a769-d98b4bc5eeea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:41.760067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 896/1792] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:14:41.761134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5f04a-6337-40d1-955a-66f293dd6f33 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:41.767373 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 897/1793] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:41.768381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc2ab4-b4f7-42fb-a769-d98b4bc5eeea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:41.771965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5f04a-6337-40d1-955a-66f293dd6f33 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:41.776963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968eb44-338b-4345-a852-47cbd09a50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:41.780007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968eb44-338b-4345-a852-47cbd09a50e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.780007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968eb44-338b-4345-a852-47cbd09a50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.780198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc2ab4-b4f7-42fb-a769-d98b4bc5eeea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:41.780293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968eb44-338b-4345-a852-47cbd09a50e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.780293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968eb44-338b-4345-a852-47cbd09a50e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:41.780293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968eb44-338b-4345-a852-47cbd09a50e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:41.781221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968eb44-338b-4345-a852-47cbd09a50e6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:41.785186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02da197-d4b2-418b-9600-334ad0388511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:41.785850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02da197-d4b2-418b-9600-334ad0388511 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.786135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02da197-d4b2-418b-9600-334ad0388511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.786414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02da197-d4b2-418b-9600-334ad0388511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.787112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02da197-d4b2-418b-9600-334ad0388511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:41.789226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02da197-d4b2-418b-9600-334ad0388511 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:41.795171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 897/1794] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:14:41.796092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968eb44-338b-4345-a852-47cbd09a50e6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:41.806166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968eb44-338b-4345-a852-47cbd09a50e6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:41.811536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f63e3-717a-419c-ac76-cd92c2c772a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:41.812482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f63e3-717a-419c-ac76-cd92c2c772a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:41.816123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f63e3-717a-419c-ac76-cd92c2c772a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:41.816123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f63e3-717a-419c-ac76-cd92c2c772a5 admin admin] PATH_INFO: `/v3/projects/af176c5d16bb4715a29eb7e54ed15024/users/1f5f796f235c4a42a3c4586e5676adb4/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:41.829224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f63e3-717a-419c-ac76-cd92c2c772a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af176c5d16bb4715a29eb7e54ed15024, user_id=1f5f796f235c4a42a3c4586e5676adb4, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:41.831904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f63e3-717a-419c-ac76-cd92c2c772a5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:41.912238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 898/1795] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:41 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:41.913707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02da197-d4b2-418b-9600-334ad0388511 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:41.977216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 898/1796] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:41 2022] PUT /identity/v3/projects/af176c5d16bb4715a29eb7e54ed15024/users/1f5f796f235c4a42a3c4586e5676adb4/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:41.978193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f63e3-717a-419c-ac76-cd92c2c772a5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.022312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02da197-d4b2-418b-9600-334ad0388511 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.103511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f63e3-717a-419c-ac76-cd92c2c772a5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.109455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23e05f-4754-4c38-84ce-79833cd68029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.110210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23e05f-4754-4c38-84ce-79833cd68029 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.110568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23e05f-4754-4c38-84ce-79833cd68029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.111034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23e05f-4754-4c38-84ce-79833cd68029 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.114727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23e05f-4754-4c38-84ce-79833cd68029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.114727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23e05f-4754-4c38-84ce-79833cd68029 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.170056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac65ab-c039-4612-9f00-a80dd472af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.170865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac65ab-c039-4612-9f00-a80dd472af13 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.171249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac65ab-c039-4612-9f00-a80dd472af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.171650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac65ab-c039-4612-9f00-a80dd472af13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.172797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac65ab-c039-4612-9f00-a80dd472af13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.175033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac65ab-c039-4612-9f00-a80dd472af13 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.231491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 899/1797] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:41 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:42.232656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23e05f-4754-4c38-84ce-79833cd68029 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.244336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23e05f-4754-4c38-84ce-79833cd68029 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.249797 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd41454-1a8c-4521-8c5c-30135a2594db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.250559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd41454-1a8c-4521-8c5c-30135a2594db admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.250845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd41454-1a8c-4521-8c5c-30135a2594db admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.251116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd41454-1a8c-4521-8c5c-30135a2594db admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.253993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd41454-1a8c-4521-8c5c-30135a2594db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.253993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd41454-1a8c-4521-8c5c-30135a2594db admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.265747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 900/1798] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:42.275377 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd41454-1a8c-4521-8c5c-30135a2594db admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.278615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd41454-1a8c-4521-8c5c-30135a2594db admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.283658 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e658119-ba9e-47c3-b0e0-0c42c2363058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.284365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e658119-ba9e-47c3-b0e0-0c42c2363058 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.284649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e658119-ba9e-47c3-b0e0-0c42c2363058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.284924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e658119-ba9e-47c3-b0e0-0c42c2363058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.285653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e658119-ba9e-47c3-b0e0-0c42c2363058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.287443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e658119-ba9e-47c3-b0e0-0c42c2363058 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.298600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 901/1799] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:42.299588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e658119-ba9e-47c3-b0e0-0c42c2363058 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.312127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e658119-ba9e-47c3-b0e0-0c42c2363058 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.318593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94a5b-3929-487d-9bbc-d3dbb2d9f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.319041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 899/1800] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:41 2022] POST /identity/v3/projects => generated 381 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:42.319440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94a5b-3929-487d-9bbc-d3dbb2d9f72f admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.319724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94a5b-3929-487d-9bbc-d3dbb2d9f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.319972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac65ab-c039-4612-9f00-a80dd472af13 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.320082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94a5b-3929-487d-9bbc-d3dbb2d9f72f admin admin] PATH_INFO: `/v3/projects/af176c5d16bb4715a29eb7e54ed15024/users/1f5f796f235c4a42a3c4586e5676adb4/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.322092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb94a5b-3929-487d-9bbc-d3dbb2d9f72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af176c5d16bb4715a29eb7e54ed15024, user_id=1f5f796f235c4a42a3c4586e5676adb4, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.325069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb94a5b-3929-487d-9bbc-d3dbb2d9f72f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.356045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 902/1801] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:42 2022] PUT /identity/v3/projects/af176c5d16bb4715a29eb7e54ed15024/users/1f5f796f235c4a42a3c4586e5676adb4/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:42.357046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94a5b-3929-487d-9bbc-d3dbb2d9f72f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.405530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac65ab-c039-4612-9f00-a80dd472af13 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.442442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94a5b-3929-487d-9bbc-d3dbb2d9f72f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.447587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374c170-afeb-4e24-b510-5294339081bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.448313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374c170-afeb-4e24-b510-5294339081bc admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.448817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374c170-afeb-4e24-b510-5294339081bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.457490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374c170-afeb-4e24-b510-5294339081bc admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.458439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374c170-afeb-4e24-b510-5294339081bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.460314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374c170-afeb-4e24-b510-5294339081bc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.483248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213c619-23ca-4c7d-8299-cceab609a3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.483956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213c619-23ca-4c7d-8299-cceab609a3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.484249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213c619-23ca-4c7d-8299-cceab609a3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.484529 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213c619-23ca-4c7d-8299-cceab609a3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.485264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213c619-23ca-4c7d-8299-cceab609a3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.486921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213c619-23ca-4c7d-8299-cceab609a3b2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.497455 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 900/1802] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:42.499505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2594a-f815-4cb6-9002-822ee381802b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.499505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2594a-f815-4cb6-9002-822ee381802b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.499505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2594a-f815-4cb6-9002-822ee381802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.528600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0ed2594a-f815-4cb6-9002-822ee381802b None None] MFA Rules not processed for user `1f5f796f235c4a42a3c4586e5676adb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:42.529830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0ed2594a-f815-4cb6-9002-822ee381802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:42.544229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 903/1803] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:42 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:42.544229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374c170-afeb-4e24-b510-5294339081bc admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.555303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374c170-afeb-4e24-b510-5294339081bc admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.564482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198da7f-1d6e-4221-8fed-47c8a4e13ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.565814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198da7f-1d6e-4221-8fed-47c8a4e13ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.566159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198da7f-1d6e-4221-8fed-47c8a4e13ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.566511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198da7f-1d6e-4221-8fed-47c8a4e13ca5 admin admin] PATH_INFO: `/v3/projects/ee57a9c5a56241b782b6808b9c8fcb9e/users/2f71c08b4d9f42358dfc0d53a23d116c/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.588529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198da7f-1d6e-4221-8fed-47c8a4e13ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee57a9c5a56241b782b6808b9c8fcb9e, user_id=2f71c08b4d9f42358dfc0d53a23d116c, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.592771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198da7f-1d6e-4221-8fed-47c8a4e13ca5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.615375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 901/1804] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:42.615375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2594a-f815-4cb6-9002-822ee381802b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.626419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2594a-f815-4cb6-9002-822ee381802b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.631269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2dde0-34ad-462f-9016-63f9145c18c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.631996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2dde0-34ad-462f-9016-63f9145c18c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.632287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2dde0-34ad-462f-9016-63f9145c18c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.632563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2dde0-34ad-462f-9016-63f9145c18c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.633298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2dde0-34ad-462f-9016-63f9145c18c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.635055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c2dde0-34ad-462f-9016-63f9145c18c2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.646196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 902/1805] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:42.647014 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2dde0-34ad-462f-9016-63f9145c18c2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.649101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-59c2dde0-34ad-462f-9016-63f9145c18c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:42.661192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 904/1806] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:42 2022] PUT /identity/v3/projects/ee57a9c5a56241b782b6808b9c8fcb9e/users/2f71c08b4d9f42358dfc0d53a23d116c/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:42.673028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198da7f-1d6e-4221-8fed-47c8a4e13ca5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.721095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2dde0-34ad-462f-9016-63f9145c18c2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.741953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198da7f-1d6e-4221-8fed-47c8a4e13ca5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.748867 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d7e12-6282-4b19-bed1-c6482fecbd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.750635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d7e12-6282-4b19-bed1-c6482fecbd73 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.750635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d7e12-6282-4b19-bed1-c6482fecbd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.750635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d7e12-6282-4b19-bed1-c6482fecbd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.750967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d7e12-6282-4b19-bed1-c6482fecbd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.752681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d7e12-6282-4b19-bed1-c6482fecbd73 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.763454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 905/1807] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:42.764720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefff4a1-f025-49e2-bc87-952495b63d22 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.765000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefff4a1-f025-49e2-bc87-952495b63d22 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.765428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefff4a1-f025-49e2-bc87-952495b63d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.773234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b3e51-d357-47c4-a625-366488726197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.773881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b3e51-d357-47c4-a625-366488726197 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.774167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b3e51-d357-47c4-a625-366488726197 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.774432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b3e51-d357-47c4-a625-366488726197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.794071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-cefff4a1-f025-49e2-bc87-952495b63d22 None None] MFA Rules not processed for user `2f71c08b4d9f42358dfc0d53a23d116c`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:42.795323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cefff4a1-f025-49e2-bc87-952495b63d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:42.836957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b3e51-d357-47c4-a625-366488726197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.838401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b3e51-d357-47c4-a625-366488726197 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.848460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 903/1808] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:42.849317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b3e51-d357-47c4-a625-366488726197 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.859824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b3e51-d357-47c4-a625-366488726197 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.861497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 906/1809] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:42.864665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603649f-7f28-4093-a2d8-aebf75c57ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.865561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603649f-7f28-4093-a2d8-aebf75c57ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.865873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603649f-7f28-4093-a2d8-aebf75c57ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.866093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefff4a1-f025-49e2-bc87-952495b63d22 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:42.866205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603649f-7f28-4093-a2d8-aebf75c57ff2 admin admin] PATH_INFO: `/v3/projects/ab5a88a3627846d59ff20e8b09c62f3a/users/ace80bd0b1eb407a8bc919db10c2f649/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.878859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefff4a1-f025-49e2-bc87-952495b63d22 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:42.883498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66058e3-ec25-49b7-8db6-a0379c80d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:42.883847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603649f-7f28-4093-a2d8-aebf75c57ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5a88a3627846d59ff20e8b09c62f3a, user_id=ace80bd0b1eb407a8bc919db10c2f649, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.884188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66058e3-ec25-49b7-8db6-a0379c80d827 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:42.884475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66058e3-ec25-49b7-8db6-a0379c80d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:42.884755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66058e3-ec25-49b7-8db6-a0379c80d827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:42.885451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66058e3-ec25-49b7-8db6-a0379c80d827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:42.886780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603649f-7f28-4093-a2d8-aebf75c57ff2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.887654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66058e3-ec25-49b7-8db6-a0379c80d827 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:42.997221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 904/1810] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:42 2022] PUT /identity/v3/projects/ab5a88a3627846d59ff20e8b09c62f3a/users/ace80bd0b1eb407a8bc919db10c2f649/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:42.999150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 907/1811] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:42 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:43.004694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603649f-7f28-4093-a2d8-aebf75c57ff2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.008567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65cfd-04ed-4217-b32e-1c7473e35dd9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.008884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65cfd-04ed-4217-b32e-1c7473e35dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.009144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65cfd-04ed-4217-b32e-1c7473e35dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.036204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b1d65cfd-04ed-4217-b32e-1c7473e35dd9 None None] MFA Rules not processed for user `ace80bd0b1eb407a8bc919db10c2f649`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:43.037532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b1d65cfd-04ed-4217-b32e-1c7473e35dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:43.071069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603649f-7f28-4093-a2d8-aebf75c57ff2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.110046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 908/1812] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:43.114543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65cfd-04ed-4217-b32e-1c7473e35dd9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.144411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb94a-3105-4b0a-b7d9-74b5ad5acf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.145179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb94a-3105-4b0a-b7d9-74b5ad5acf5c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.145538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb94a-3105-4b0a-b7d9-74b5ad5acf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.145910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb94a-3105-4b0a-b7d9-74b5ad5acf5c admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.146687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb94a-3105-4b0a-b7d9-74b5ad5acf5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.148751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb94a-3105-4b0a-b7d9-74b5ad5acf5c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:43.180093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65cfd-04ed-4217-b32e-1c7473e35dd9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.184930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0208d5-366c-48ca-ab3b-e3ab253fa3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.185700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0208d5-366c-48ca-ab3b-e3ab253fa3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.185989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0208d5-366c-48ca-ab3b-e3ab253fa3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.186264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0208d5-366c-48ca-ab3b-e3ab253fa3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.186956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0208d5-366c-48ca-ab3b-e3ab253fa3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.189157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0208d5-366c-48ca-ab3b-e3ab253fa3a9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:43.238883 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:43.245314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 905/1813] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:43 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:43.249278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb94a-3105-4b0a-b7d9-74b5ad5acf5c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.259076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb94a-3105-4b0a-b7d9-74b5ad5acf5c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.264540 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7cee1-2e97-4f57-8b21-adc3c8364feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.265815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7cee1-2e97-4f57-8b21-adc3c8364feb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.265815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7cee1-2e97-4f57-8b21-adc3c8364feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.265815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7cee1-2e97-4f57-8b21-adc3c8364feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.266588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7cee1-2e97-4f57-8b21-adc3c8364feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.268222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7cee1-2e97-4f57-8b21-adc3c8364feb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:43.279028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 906/1814] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:43.283097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7cee1-2e97-4f57-8b21-adc3c8364feb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.292572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7cee1-2e97-4f57-8b21-adc3c8364feb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.295620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 909/1815] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:43 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:43.297387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295a08-9b95-4942-ad83-2fd07d8fe7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.300162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295a08-9b95-4942-ad83-2fd07d8fe7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.300162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295a08-9b95-4942-ad83-2fd07d8fe7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.300162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295a08-9b95-4942-ad83-2fd07d8fe7bf admin admin] PATH_INFO: `/v3/projects/2e4eec4831604ad5ad1058b0eca31c8b/users/e81cfdba11014ca992204f9971ea4a02/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.302963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0208d5-366c-48ca-ab3b-e3ab253fa3a9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.323319 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11295a08-9b95-4942-ad83-2fd07d8fe7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4eec4831604ad5ad1058b0eca31c8b, user_id=e81cfdba11014ca992204f9971ea4a02, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.323319 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11295a08-9b95-4942-ad83-2fd07d8fe7bf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:43.366969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0208d5-366c-48ca-ab3b-e3ab253fa3a9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.368415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 907/1816] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:43 2022] PUT /identity/v3/projects/2e4eec4831604ad5ad1058b0eca31c8b/users/e81cfdba11014ca992204f9971ea4a02/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:43.372508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295a08-9b95-4942-ad83-2fd07d8fe7bf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.418716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:43.497150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d3fa4-6c5b-4644-a9cf-258e17e046e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.497150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d3fa4-6c5b-4644-a9cf-258e17e046e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.497150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d3fa4-6c5b-4644-a9cf-258e17e046e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.497150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d3fa4-6c5b-4644-a9cf-258e17e046e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.498223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d3fa4-6c5b-4644-a9cf-258e17e046e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.498223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d3fa4-6c5b-4644-a9cf-258e17e046e9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:43.500129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295a08-9b95-4942-ad83-2fd07d8fe7bf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.512302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678bc57-5a84-4cd1-8a05-67f5563119d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.513636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678bc57-5a84-4cd1-8a05-67f5563119d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.514749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678bc57-5a84-4cd1-8a05-67f5563119d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.515455 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678bc57-5a84-4cd1-8a05-67f5563119d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.519155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678bc57-5a84-4cd1-8a05-67f5563119d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.523009 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678bc57-5a84-4cd1-8a05-67f5563119d5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:43.546892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 908/1817] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:43.550795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678bc57-5a84-4cd1-8a05-67f5563119d5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.565843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678bc57-5a84-4cd1-8a05-67f5563119d5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.571777 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eea9f0-2ad4-459d-a91b-aa756fb211e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.574796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eea9f0-2ad4-459d-a91b-aa756fb211e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.574796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eea9f0-2ad4-459d-a91b-aa756fb211e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.574796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eea9f0-2ad4-459d-a91b-aa756fb211e4 admin admin] PATH_INFO: `/v3/projects/2e4eec4831604ad5ad1058b0eca31c8b/users/e81cfdba11014ca992204f9971ea4a02/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.576134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eea9f0-2ad4-459d-a91b-aa756fb211e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4eec4831604ad5ad1058b0eca31c8b, user_id=e81cfdba11014ca992204f9971ea4a02, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.581749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eea9f0-2ad4-459d-a91b-aa756fb211e4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:43.595301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 909/1818] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:43 2022] PUT /identity/v3/projects/2e4eec4831604ad5ad1058b0eca31c8b/users/e81cfdba11014ca992204f9971ea4a02/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:43.605444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d1ce5-14d1-40b1-acd4-d670eb460546 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.605936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d1ce5-14d1-40b1-acd4-d670eb460546 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.606402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d1ce5-14d1-40b1-acd4-d670eb460546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.610598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 910/1819] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:43 2022] POST /identity/v3/users => generated 298 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:43.614262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d3fa4-6c5b-4644-a9cf-258e17e046e9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.625081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d3fa4-6c5b-4644-a9cf-258e17e046e9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.639211 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ec4d1ce5-14d1-40b1-acd4-d670eb460546 None None] MFA Rules not processed for user `e81cfdba11014ca992204f9971ea4a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:43.640702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ec4d1ce5-14d1-40b1-acd4-d670eb460546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:43.709932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef50a98-7b1d-4b57-95c1-9524ca4cc0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.710591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef50a98-7b1d-4b57-95c1-9524ca4cc0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.710945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef50a98-7b1d-4b57-95c1-9524ca4cc0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.711290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef50a98-7b1d-4b57-95c1-9524ca4cc0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.712431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef50a98-7b1d-4b57-95c1-9524ca4cc0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.714386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef50a98-7b1d-4b57-95c1-9524ca4cc0d9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:43.727817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 911/1820] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:43.732684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef50a98-7b1d-4b57-95c1-9524ca4cc0d9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.751899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef50a98-7b1d-4b57-95c1-9524ca4cc0d9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.763693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef627c52-f097-45a9-9b29-37d7fb4b8784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.764902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627c52-f097-45a9-9b29-37d7fb4b8784 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.765181 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627c52-f097-45a9-9b29-37d7fb4b8784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.765452 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627c52-f097-45a9-9b29-37d7fb4b8784 admin admin] PATH_INFO: `/v3/projects/dee2f925d8d14fada1793d17e2576a94/users/caf252debdd84d26bb0bf8cb6992f248/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.772395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 910/1821] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:43.798731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef627c52-f097-45a9-9b29-37d7fb4b8784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee2f925d8d14fada1793d17e2576a94, user_id=caf252debdd84d26bb0bf8cb6992f248, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.799245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d1ce5-14d1-40b1-acd4-d670eb460546 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.802526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef627c52-f097-45a9-9b29-37d7fb4b8784 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:43.865069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d1ce5-14d1-40b1-acd4-d670eb460546 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.877037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 912/1822] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:43 2022] PUT /identity/v3/projects/dee2f925d8d14fada1793d17e2576a94/users/caf252debdd84d26bb0bf8cb6992f248/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:43.877037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef627c52-f097-45a9-9b29-37d7fb4b8784 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:43.927035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ea6b4-c0b6-48c7-b9a1-2106c2ce59d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.927786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ea6b4-c0b6-48c7-b9a1-2106c2ce59d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.928198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ea6b4-c0b6-48c7-b9a1-2106c2ce59d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.928544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ea6b4-c0b6-48c7-b9a1-2106c2ce59d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.964032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef627c52-f097-45a9-9b29-37d7fb4b8784 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:43.970209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:43.972482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:43.972482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:43.972482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] PATH_INFO: `/v3/users/4860899cf6b64b7eb3eacbfc84fe084b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:43.973263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4860899cf6b64b7eb3eacbfc84fe084b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:43.975275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:44.004532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ea6b4-c0b6-48c7-b9a1-2106c2ce59d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:44.005970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ea6b4-c0b6-48c7-b9a1-2106c2ce59d7 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:44.015813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 911/1823] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:44.016622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ea6b4-c0b6-48c7-b9a1-2106c2ce59d7 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:44.026043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ea6b4-c0b6-48c7-b9a1-2106c2ce59d7 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:44.030764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73ba72-734e-4c14-b5f2-0927affeef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:44.031411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73ba72-734e-4c14-b5f2-0927affeef39 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:44.031696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73ba72-734e-4c14-b5f2-0927affeef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:44.032006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73ba72-734e-4c14-b5f2-0927affeef39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:44.033072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73ba72-734e-4c14-b5f2-0927affeef39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:44.034293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73ba72-734e-4c14-b5f2-0927affeef39 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:44.044885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 912/1824] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:44.048922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73ba72-734e-4c14-b5f2-0927affeef39 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:44.058888 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73ba72-734e-4c14-b5f2-0927affeef39 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:44.063897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eb4d9-cc40-4c19-aa8a-a6d792d42468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:44.064918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb4d9-cc40-4c19-aa8a-a6d792d42468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:44.065217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb4d9-cc40-4c19-aa8a-a6d792d42468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:44.065538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb4d9-cc40-4c19-aa8a-a6d792d42468 admin admin] PATH_INFO: `/v3/projects/dee2f925d8d14fada1793d17e2576a94/users/caf252debdd84d26bb0bf8cb6992f248/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:44.067714 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eb4d9-cc40-4c19-aa8a-a6d792d42468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee2f925d8d14fada1793d17e2576a94, user_id=caf252debdd84d26bb0bf8cb6992f248, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:44.070448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39eb4d9-cc40-4c19-aa8a-a6d792d42468 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:44.081466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 913/1825] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:44 2022] PUT /identity/v3/projects/dee2f925d8d14fada1793d17e2576a94/users/caf252debdd84d26bb0bf8cb6992f248/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:44.092013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400484-1b04-4046-ba92-d3e5da0db5b2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:44.092339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400484-1b04-4046-ba92-d3e5da0db5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:44.092614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400484-1b04-4046-ba92-d3e5da0db5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:44.119772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c4400484-1b04-4046-ba92-d3e5da0db5b2 None None] MFA Rules not processed for user `caf252debdd84d26bb0bf8cb6992f248`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:44.122073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c4400484-1b04-4046-ba92-d3e5da0db5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:44.149490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4860899cf6b64b7eb3eacbfc84fe084b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:44.158707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4860899cf6b64b7eb3eacbfc84fe084b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:44.196044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 914/1826] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:44.206796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4400484-1b04-4046-ba92-d3e5da0db5b2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:44.209023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4860899cf6b64b7eb3eacbfc84fe084b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:44.209950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4860899cf6b64b7eb3eacbfc84fe084b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:44.228694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4860899cf6b64b7eb3eacbfc84fe084b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:44.235617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 913/1827] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:43 2022] DELETE /identity/v3/users/4860899cf6b64b7eb3eacbfc84fe084b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:44.236457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:44.237781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:44.263625 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4400484-1b04-4046-ba92-d3e5da0db5b2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:44.300396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab462f5c-a46e-44ee-82a6-ae19dba7c457 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:44.304201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7080d-c373-44ee-8a93-6f74e360d80c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:44.304852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7080d-c373-44ee-8a93-6f74e360d80c service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:44.305138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7080d-c373-44ee-8a93-6f74e360d80c service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:44.305417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7080d-c373-44ee-8a93-6f74e360d80c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:44.307270 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fbe7080d-c373-44ee-8a93-6f74e360d80c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:44.314047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:44.314740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:44.315942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:44.316261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:44.318454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:44.379096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7080d-c373-44ee-8a93-6f74e360d80c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:44.380612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7080d-c373-44ee-8a93-6f74e360d80c service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:44.389560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:44.391014 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:44.392321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 914/1828] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:44.393679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36662e3-8fe3-4998-8c28-cbfe26d0d966 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:44.393972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36662e3-8fe3-4998-8c28-cbfe26d0d966 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:44.394252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36662e3-8fe3-4998-8c28-cbfe26d0d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:44.403506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 915/1829] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:44.415653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e36662e3-8fe3-4998-8c28-cbfe26d0d966 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:44.418072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e36662e3-8fe3-4998-8c28-cbfe26d0d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:44.486158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 915/1830] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:44.497185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:44.502102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:44.515238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36662e3-8fe3-4998-8c28-cbfe26d0d966 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:44.516664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e36662e3-8fe3-4998-8c28-cbfe26d0d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:44.533036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36662e3-8fe3-4998-8c28-cbfe26d0d966 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:44.536769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:44.537437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:44.537712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:44.538010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:44.539809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:44.558840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cc502-96bd-4c45-931c-9a532cc71583 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:44.562637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fb74a-fc73-49f2-bf5e-d8c2cbd7cfb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:44.563284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fb74a-fc73-49f2-bf5e-d8c2cbd7cfb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:44.563822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fb74a-fc73-49f2-bf5e-d8c2cbd7cfb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:44.564142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fb74a-fc73-49f2-bf5e-d8c2cbd7cfb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:44.571597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:44.575850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fb74a-fc73-49f2-bf5e-d8c2cbd7cfb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:44.578728 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fb74a-fc73-49f2-bf5e-d8c2cbd7cfb1 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:44.586989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 916/1831] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:44.601534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:44.603462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:44.613384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 916/1832] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:44.705757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:44.866611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fb74a-fc73-49f2-bf5e-d8c2cbd7cfb1 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:44.868960 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f31fb74a-fc73-49f2-bf5e-d8c2cbd7cfb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:44.884245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fb74a-fc73-49f2-bf5e-d8c2cbd7cfb1 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:44.892460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:44.894519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:44.894816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:44.895142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] PATH_INFO: `/v3/users/77207234acad44f28cbe59c185c3c046` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:44.897603 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77207234acad44f28cbe59c185c3c046)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:44.900394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:45.095559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:45.100613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:45.118770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c037191-3b7e-413a-9324-a2244f946d51 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:45.133549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:45.134445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:45.136437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:45.136813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] PATH_INFO: `/v3/projects/5274c1feaa1547a49ffe41ddcc11845b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:45.138350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5274c1feaa1547a49ffe41ddcc11845b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:45.140417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:45.168875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77207234acad44f28cbe59c185c3c046'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.176483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77207234acad44f28cbe59c185c3c046'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.177346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77207234acad44f28cbe59c185c3c046'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.195597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77207234acad44f28cbe59c185c3c046'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.271438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5274c1feaa1547a49ffe41ddcc11845b', 'request_id': 'req-3898d684-1b9c-4c11-a185-2f6f340558f3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.278060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5274c1feaa1547a49ffe41ddcc11845b', 'request_id': 'req-3898d684-1b9c-4c11-a185-2f6f340558f3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.283405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5274c1feaa1547a49ffe41ddcc11845b', 'request_id': 'req-3898d684-1b9c-4c11-a185-2f6f340558f3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.288548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a200776b-ae9d-4e6e-9b3c-75861a97759f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77207234acad44f28cbe59c185c3c046'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.296155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 917/1833] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:44 2022] DELETE /identity/v3/users/77207234acad44f28cbe59c185c3c046 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:45.303367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b3224-623f-4a87-bd9d-5225cddd1920 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:45.303583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b3224-623f-4a87-bd9d-5225cddd1920 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:45.303862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b3224-623f-4a87-bd9d-5225cddd1920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:45.322001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e59b3224-623f-4a87-bd9d-5225cddd1920 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:45.323232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e59b3224-623f-4a87-bd9d-5225cddd1920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:45.382619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 918/1834] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:45.392294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b3224-623f-4a87-bd9d-5225cddd1920 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:45.393649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e59b3224-623f-4a87-bd9d-5225cddd1920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:45.425094 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] The token cache is being invalidate because project 5274c1feaa1547a49ffe41ddcc11845b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:45.425382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.426003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.427602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 917/1835] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:45 2022] DELETE /identity/v3/projects/5274c1feaa1547a49ffe41ddcc11845b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:45.431477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:45.436131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:45.450488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b3224-623f-4a87-bd9d-5225cddd1920 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:45.454151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:45.454807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:45.455094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:45.455373 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:45.457181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:45.470495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:45.471073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:45.472386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:45.482670 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 919/1836] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:45.501186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d684-1b9c-4c11-a185-2f6f340558f3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:45.510585 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:45.512473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:45.512754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:45.513050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] PATH_INFO: `/v3/users/1f5f796f235c4a42a3c4586e5676adb4` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:45.514282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5f796f235c4a42a3c4586e5676adb4)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:45.516240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:45.732929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5f796f235c4a42a3c4586e5676adb4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.740036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5f796f235c4a42a3c4586e5676adb4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.802607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:45.830738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5f796f235c4a42a3c4586e5676adb4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.831444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5f796f235c4a42a3c4586e5676adb4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.844537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5f796f235c4a42a3c4586e5676adb4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:45.850604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 918/1837] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:45 2022] DELETE /identity/v3/users/1f5f796f235c4a42a3c4586e5676adb4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:45.929876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:45.931627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:45.946654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf50e6-168d-41ef-a88c-d4c09c125357 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:46.009019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:46.009887 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:46.010200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:46.010478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] PATH_INFO: `/v3/projects/e10ef1285daf42ef80208d8ddc55e081` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:46.011863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10ef1285daf42ef80208d8ddc55e081)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:46.013945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:46.153186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10ef1285daf42ef80208d8ddc55e081', 'request_id': 'req-7b8def59-351a-42ae-a31a-eeba013305b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.292698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10ef1285daf42ef80208d8ddc55e081', 'request_id': 'req-7b8def59-351a-42ae-a31a-eeba013305b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.300695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10ef1285daf42ef80208d8ddc55e081', 'request_id': 'req-7b8def59-351a-42ae-a31a-eeba013305b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.312075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:46.316325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] The token cache is being invalidate because project e10ef1285daf42ef80208d8ddc55e081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:46.316871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.317681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.322558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 920/1838] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:45 2022] DELETE /identity/v3/projects/e10ef1285daf42ef80208d8ddc55e081 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:46.323745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:46.325589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:46.343186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c4a62-54d8-4e9e-999c-38f5468f38ac admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:46.407961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:46.408874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:46.409151 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:46.409434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] PATH_INFO: `/v3/users/3cca2a88973244018d20dc4f2c7de641` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:46.411089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cca2a88973244018d20dc4f2c7de641)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:46.413290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:46.580952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:46.581808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:46.597366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8def59-351a-42ae-a31a-eeba013305b5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:46.602853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:46.603796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:46.604106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:46.606781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] PATH_INFO: `/v3/projects/af176c5d16bb4715a29eb7e54ed15024` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:46.606781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af176c5d16bb4715a29eb7e54ed15024)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:46.608015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:46.646959 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cca2a88973244018d20dc4f2c7de641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.654750 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cca2a88973244018d20dc4f2c7de641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.739249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cca2a88973244018d20dc4f2c7de641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.739976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af176c5d16bb4715a29eb7e54ed15024', 'request_id': 'req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.740126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cca2a88973244018d20dc4f2c7de641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.743023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:46.755587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4577796b-120c-494e-9a73-ef33cb26e7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cca2a88973244018d20dc4f2c7de641'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.762577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 919/1839] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:46 2022] DELETE /identity/v3/users/3cca2a88973244018d20dc4f2c7de641 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:46.831496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af176c5d16bb4715a29eb7e54ed15024', 'request_id': 'req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.839994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af176c5d16bb4715a29eb7e54ed15024', 'request_id': 'req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.854842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] The token cache is being invalidate because project af176c5d16bb4715a29eb7e54ed15024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:46.854842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.855966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f44a6289-dc24-4bd9-bc68-bb22d03e03d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:46.862861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 921/1840] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:46 2022] DELETE /identity/v3/projects/af176c5d16bb4715a29eb7e54ed15024 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:46.868514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c340db-cdc4-4c6b-85ac-ab352821e0c8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:46.868828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c340db-cdc4-4c6b-85ac-ab352821e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:46.869140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c340db-cdc4-4c6b-85ac-ab352821e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:46.890457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-23c340db-cdc4-4c6b-85ac-ab352821e0c8 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:46.891667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-23c340db-cdc4-4c6b-85ac-ab352821e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:46.950251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 920/1841] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:46.959480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3ba06-3d02-4634-b969-884ae2bbd1b0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:46.959859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3ba06-3d02-4634-b969-884ae2bbd1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:46.960218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3ba06-3d02-4634-b969-884ae2bbd1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:46.979207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5aa3ba06-3d02-4634-b969-884ae2bbd1b0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:46.981182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5aa3ba06-3d02-4634-b969-884ae2bbd1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:46.989991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 922/1842] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:46.996847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c340db-cdc4-4c6b-85ac-ab352821e0c8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.007275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c340db-cdc4-4c6b-85ac-ab352821e0c8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.014242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d82392-6da9-4ac9-980b-5258736081d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.015065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d82392-6da9-4ac9-980b-5258736081d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.015417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d82392-6da9-4ac9-980b-5258736081d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.015763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d82392-6da9-4ac9-980b-5258736081d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.016959 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d82392-6da9-4ac9-980b-5258736081d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:47.017580 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d82392-6da9-4ac9-980b-5258736081d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.019691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d82392-6da9-4ac9-980b-5258736081d6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.035775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 921/1843] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:14:47.036971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3ba06-3d02-4634-b969-884ae2bbd1b0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.047472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3ba06-3d02-4634-b969-884ae2bbd1b0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.052623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b47780-9b30-42eb-8edb-09506768b5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.052933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b47780-9b30-42eb-8edb-09506768b5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.053236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b47780-9b30-42eb-8edb-09506768b5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.053513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b47780-9b30-42eb-8edb-09506768b5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.054398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b47780-9b30-42eb-8edb-09506768b5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.056594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b47780-9b30-42eb-8edb-09506768b5f3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.164328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 923/1844] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:47 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:47.169530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d82392-6da9-4ac9-980b-5258736081d6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.179488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d82392-6da9-4ac9-980b-5258736081d6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.200779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b47780-9b30-42eb-8edb-09506768b5f3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.202964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11b47780-9b30-42eb-8edb-09506768b5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:47.230419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:47.246128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5931c04-7ece-419a-9710-d5bc8e0c2454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.246939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5931c04-7ece-419a-9710-d5bc8e0c2454 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.247226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5931c04-7ece-419a-9710-d5bc8e0c2454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.247497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5931c04-7ece-419a-9710-d5bc8e0c2454 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.248299 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5931c04-7ece-419a-9710-d5bc8e0c2454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.250215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5931c04-7ece-419a-9710-d5bc8e0c2454 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.254624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:47.276947 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b47780-9b30-42eb-8edb-09506768b5f3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.281595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.282457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.282761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.283023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] PATH_INFO: `/v3/projects/127a19988a7c4ec69a5103b84ebbe3cb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.284249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127a19988a7c4ec69a5103b84ebbe3cb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.286191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.377913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 922/1845] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:47 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:47.379403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5931c04-7ece-419a-9710-d5bc8e0c2454 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.400461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5931c04-7ece-419a-9710-d5bc8e0c2454 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.415993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d79d7-2c2f-4fdb-8819-2fba78b75306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.416755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d79d7-2c2f-4fdb-8819-2fba78b75306 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.417777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d79d7-2c2f-4fdb-8819-2fba78b75306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.418165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d79d7-2c2f-4fdb-8819-2fba78b75306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.419319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d79d7-2c2f-4fdb-8819-2fba78b75306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.421114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d79d7-2c2f-4fdb-8819-2fba78b75306 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.423119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127a19988a7c4ec69a5103b84ebbe3cb', 'request_id': 'req-f20a2bba-df09-47c8-b6a5-4854c5e31723'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:47.441010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 923/1846] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:47.444863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d79d7-2c2f-4fdb-8819-2fba78b75306 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.461475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d79d7-2c2f-4fdb-8819-2fba78b75306 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.509281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127a19988a7c4ec69a5103b84ebbe3cb', 'request_id': 'req-f20a2bba-df09-47c8-b6a5-4854c5e31723'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:47.519181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127a19988a7c4ec69a5103b84ebbe3cb', 'request_id': 'req-f20a2bba-df09-47c8-b6a5-4854c5e31723'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:47.558766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] The token cache is being invalidate because project 127a19988a7c4ec69a5103b84ebbe3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:47.559076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:47.560305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f20a2bba-df09-47c8-b6a5-4854c5e31723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:47.564216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cfd8b-3a3e-413c-b2f4-0830b20d1588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.564904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cfd8b-3a3e-413c-b2f4-0830b20d1588 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.565186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cfd8b-3a3e-413c-b2f4-0830b20d1588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.565509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cfd8b-3a3e-413c-b2f4-0830b20d1588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.566253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cfd8b-3a3e-413c-b2f4-0830b20d1588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.567909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cfd8b-3a3e-413c-b2f4-0830b20d1588 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.572933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 924/1847] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:47 2022] DELETE /identity/v3/projects/127a19988a7c4ec69a5103b84ebbe3cb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:47.581021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761acc87-e27c-4de8-be72-465294d2cfec None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.581021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761acc87-e27c-4de8-be72-465294d2cfec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.581021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761acc87-e27c-4de8-be72-465294d2cfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.591035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 924/1848] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:47.595474 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cfd8b-3a3e-413c-b2f4-0830b20d1588 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.601357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1c9cfd8b-3a3e-413c-b2f4-0830b20d1588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:47.615050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-761acc87-e27c-4de8-be72-465294d2cfec None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:47.617709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-761acc87-e27c-4de8-be72-465294d2cfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:47.622546 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cfd8b-3a3e-413c-b2f4-0830b20d1588 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.629603 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0fb16-0d18-42bd-90c5-f785ec40d00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.637489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 925/1849] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:47.637773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0fb16-0d18-42bd-90c5-f785ec40d00b admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.637773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0fb16-0d18-42bd-90c5-f785ec40d00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.637773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0fb16-0d18-42bd-90c5-f785ec40d00b admin admin] PATH_INFO: `/v3/projects/907b3c649e3742288c024f90bde9c41c/users/75b32017834041e7a8c27224ef4aa618/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.639471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20de6c-6edd-492f-a3bc-1ba7dba74f27 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.639772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20de6c-6edd-492f-a3bc-1ba7dba74f27 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.640262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20de6c-6edd-492f-a3bc-1ba7dba74f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.663752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0fb16-0d18-42bd-90c5-f785ec40d00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=907b3c649e3742288c024f90bde9c41c, user_id=75b32017834041e7a8c27224ef4aa618, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.666557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0fb16-0d18-42bd-90c5-f785ec40d00b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.676975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9e20de6c-6edd-492f-a3bc-1ba7dba74f27 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:47.678536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9e20de6c-6edd-492f-a3bc-1ba7dba74f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:47.687917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 926/1850] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:47.697905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20de6c-6edd-492f-a3bc-1ba7dba74f27 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.708592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20de6c-6edd-492f-a3bc-1ba7dba74f27 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.716494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcd87f-7dd0-43e6-bfbb-630723b5b951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.718837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcd87f-7dd0-43e6-bfbb-630723b5b951 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.718837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcd87f-7dd0-43e6-bfbb-630723b5b951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.718837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcd87f-7dd0-43e6-bfbb-630723b5b951 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.719579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcd87f-7dd0-43e6-bfbb-630723b5b951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:47.720084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcd87f-7dd0-43e6-bfbb-630723b5b951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.722020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcd87f-7dd0-43e6-bfbb-630723b5b951 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.741060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 927/1851] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:14:47.743532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcd87f-7dd0-43e6-bfbb-630723b5b951 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.755144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcd87f-7dd0-43e6-bfbb-630723b5b951 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.767162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 925/1852] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:47 2022] PUT /identity/v3/projects/907b3c649e3742288c024f90bde9c41c/users/75b32017834041e7a8c27224ef4aa618/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:47.778693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9488c-460e-4107-849e-e13e12268b91 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.779148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9488c-460e-4107-849e-e13e12268b91 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.779497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9488c-460e-4107-849e-e13e12268b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.811518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c2a9488c-460e-4107-849e-e13e12268b91 None None] MFA Rules not processed for user `75b32017834041e7a8c27224ef4aa618`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:47.814167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c2a9488c-460e-4107-849e-e13e12268b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:47.844585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d3340-b6c5-4e10-87a3-ebd0f825bc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.845318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d3340-b6c5-4e10-87a3-ebd0f825bc71 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.845615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d3340-b6c5-4e10-87a3-ebd0f825bc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.846583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d3340-b6c5-4e10-87a3-ebd0f825bc71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.847305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d3340-b6c5-4e10-87a3-ebd0f825bc71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.849917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d3340-b6c5-4e10-87a3-ebd0f825bc71 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.898960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 926/1853] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:47.903938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9488c-460e-4107-849e-e13e12268b91 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:47.915096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9488c-460e-4107-849e-e13e12268b91 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:47.920538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22654075-d313-4a15-864a-04e9cd950093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:47.921143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22654075-d313-4a15-864a-04e9cd950093 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:47.921435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22654075-d313-4a15-864a-04e9cd950093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:47.921717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22654075-d313-4a15-864a-04e9cd950093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:47.922416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22654075-d313-4a15-864a-04e9cd950093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:47.924348 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22654075-d313-4a15-864a-04e9cd950093 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:47.955497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 928/1854] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:47 2022] POST /identity/v3/projects => generated 409 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:47.956756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d3340-b6c5-4e10-87a3-ebd0f825bc71 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.009458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:48.021475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 927/1855] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:47 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:48.021653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d3340-b6c5-4e10-87a3-ebd0f825bc71 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.022742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22654075-d313-4a15-864a-04e9cd950093 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.077724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:48.080098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e087f-20e6-4e4f-9b84-86425efc6307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.080876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e087f-20e6-4e4f-9b84-86425efc6307 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.081165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e087f-20e6-4e4f-9b84-86425efc6307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.081450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e087f-20e6-4e4f-9b84-86425efc6307 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.082149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e087f-20e6-4e4f-9b84-86425efc6307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.084105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e087f-20e6-4e4f-9b84-86425efc6307 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.092281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22654075-d313-4a15-864a-04e9cd950093 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.097424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e856b-48c0-44c6-bd6a-60df1795de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.098096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e856b-48c0-44c6-bd6a-60df1795de28 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.098385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e856b-48c0-44c6-bd6a-60df1795de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.098667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e856b-48c0-44c6-bd6a-60df1795de28 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.099380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e856b-48c0-44c6-bd6a-60df1795de28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.101385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e856b-48c0-44c6-bd6a-60df1795de28 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.159932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 929/1856] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:47 2022] POST /identity/v3/users => generated 305 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:48.159932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e087f-20e6-4e4f-9b84-86425efc6307 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.159932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a21e087f-20e6-4e4f-9b84-86425efc6307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:48.171415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e087f-20e6-4e4f-9b84-86425efc6307 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.176256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.177587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.177587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.177857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] PATH_INFO: `/v3/users/2f71c08b4d9f42358dfc0d53a23d116c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.179072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f71c08b4d9f42358dfc0d53a23d116c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.183080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 928/1857] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:48 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:48.183080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e856b-48c0-44c6-bd6a-60df1795de28 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.183531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.191430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e856b-48c0-44c6-bd6a-60df1795de28 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.196347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfb864-4951-4007-a31b-2345c5d56447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.197012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfb864-4951-4007-a31b-2345c5d56447 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.197301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfb864-4951-4007-a31b-2345c5d56447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.197584 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfb864-4951-4007-a31b-2345c5d56447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.198982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfb864-4951-4007-a31b-2345c5d56447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.200708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfb864-4951-4007-a31b-2345c5d56447 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.210638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 929/1858] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:48.211497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfb864-4951-4007-a31b-2345c5d56447 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.222057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfb864-4951-4007-a31b-2345c5d56447 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.226766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b030c-53a1-42ad-9fd8-9ad38ec73a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.227423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b030c-53a1-42ad-9fd8-9ad38ec73a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.227711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b030c-53a1-42ad-9fd8-9ad38ec73a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.228021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b030c-53a1-42ad-9fd8-9ad38ec73a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.228757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b030c-53a1-42ad-9fd8-9ad38ec73a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.230364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b030c-53a1-42ad-9fd8-9ad38ec73a2d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.242068 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 930/1859] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:48.242872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b030c-53a1-42ad-9fd8-9ad38ec73a2d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.253228 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b030c-53a1-42ad-9fd8-9ad38ec73a2d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.257977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a502d-f5fd-4a76-9537-0a414684a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.258622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a502d-f5fd-4a76-9537-0a414684a433 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.258903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a502d-f5fd-4a76-9537-0a414684a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.259176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a502d-f5fd-4a76-9537-0a414684a433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.259954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a502d-f5fd-4a76-9537-0a414684a433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.262195 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a502d-f5fd-4a76-9537-0a414684a433 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.272160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 931/1860] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:48.273070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a502d-f5fd-4a76-9537-0a414684a433 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.282819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a502d-f5fd-4a76-9537-0a414684a433 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.287504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b2c47-d140-4332-9593-7e27f230cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.288411 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2c47-d140-4332-9593-7e27f230cc85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.288688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2c47-d140-4332-9593-7e27f230cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.288962 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b2c47-d140-4332-9593-7e27f230cc85 admin admin] PATH_INFO: `/v3/projects/02b42c3413d74804b048afe57cffa227/users/7e43d9fc96064192a4b9f69242f1edbd/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.303130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b2c47-d140-4332-9593-7e27f230cc85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b42c3413d74804b048afe57cffa227, user_id=7e43d9fc96064192a4b9f69242f1edbd, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.305845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b2c47-d140-4332-9593-7e27f230cc85 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.393944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f71c08b4d9f42358dfc0d53a23d116c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:48.395954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 932/1861] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:48 2022] PUT /identity/v3/projects/02b42c3413d74804b048afe57cffa227/users/7e43d9fc96064192a4b9f69242f1edbd/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:48.397421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b2c47-d140-4332-9593-7e27f230cc85 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.403383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f71c08b4d9f42358dfc0d53a23d116c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:48.404185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f71c08b4d9f42358dfc0d53a23d116c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:48.416387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f71c08b4d9f42358dfc0d53a23d116c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:48.460598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b2c47-d140-4332-9593-7e27f230cc85 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.465805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eccd37-42ae-4742-b2ad-55cf4f955999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.466908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eccd37-42ae-4742-b2ad-55cf4f955999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.467193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eccd37-42ae-4742-b2ad-55cf4f955999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.467502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eccd37-42ae-4742-b2ad-55cf4f955999 admin admin] PATH_INFO: `/v3/projects/19740d52aa5a4c818d181ab5808388e6/users/4cb9b358d3634691b632d64bf4f4db25/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.470312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f71c08b4d9f42358dfc0d53a23d116c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:48.482908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 930/1862] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:48 2022] DELETE /identity/v3/users/2f71c08b4d9f42358dfc0d53a23d116c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:48.483902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.485305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:48.491175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eccd37-42ae-4742-b2ad-55cf4f955999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19740d52aa5a4c818d181ab5808388e6, user_id=4cb9b358d3634691b632d64bf4f4db25, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.494196 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eccd37-42ae-4742-b2ad-55cf4f955999 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.554172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f0897-5388-45e9-923f-15986aeb6b72 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.561090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcb07e-b628-4810-9f98-b3a2366cf871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.561760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb07e-b628-4810-9f98-b3a2366cf871 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.562042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb07e-b628-4810-9f98-b3a2366cf871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.562323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb07e-b628-4810-9f98-b3a2366cf871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.563057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcb07e-b628-4810-9f98-b3a2366cf871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.565004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcb07e-b628-4810-9f98-b3a2366cf871 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.575323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 931/1863] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:48.576610 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185431-ecbc-4d1d-897e-f18ae0f26745 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.576898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185431-ecbc-4d1d-897e-f18ae0f26745 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.577178 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185431-ecbc-4d1d-897e-f18ae0f26745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.586890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 933/1864] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:48 2022] PUT /identity/v3/projects/19740d52aa5a4c818d181ab5808388e6/users/4cb9b358d3634691b632d64bf4f4db25/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:48.587482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eccd37-42ae-4742-b2ad-55cf4f955999 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.609397 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-76185431-ecbc-4d1d-897e-f18ae0f26745 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:48.611502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76185431-ecbc-4d1d-897e-f18ae0f26745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:48.678636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:48.701992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eccd37-42ae-4742-b2ad-55cf4f955999 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.708438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 932/1865] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:48.714504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c03e-bbb9-4668-a8f5-008690619a76 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.714894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c03e-bbb9-4668-a8f5-008690619a76 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.715923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c03e-bbb9-4668-a8f5-008690619a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.716030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5b44-9690-4bce-a578-3c38648e76cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.717888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5b44-9690-4bce-a578-3c38648e76cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.718176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5b44-9690-4bce-a578-3c38648e76cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.718459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5b44-9690-4bce-a578-3c38648e76cb admin admin] PATH_INFO: `/v3/projects/02b42c3413d74804b048afe57cffa227/users/7e43d9fc96064192a4b9f69242f1edbd/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.724233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5b44-9690-4bce-a578-3c38648e76cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b42c3413d74804b048afe57cffa227, user_id=7e43d9fc96064192a4b9f69242f1edbd, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:48.727433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5b44-9690-4bce-a578-3c38648e76cb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:48.748261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 934/1866] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:48 2022] PUT /identity/v3/projects/02b42c3413d74804b048afe57cffa227/users/7e43d9fc96064192a4b9f69242f1edbd/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:48.752065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5b44-9690-4bce-a578-3c38648e76cb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:48.758224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5aca5b44-9690-4bce-a578-3c38648e76cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:48.768019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5155c03e-bbb9-4668-a8f5-008690619a76 None None] MFA Rules not processed for user `4cb9b358d3634691b632d64bf4f4db25`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:48.769589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5155c03e-bbb9-4668-a8f5-008690619a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:48.904019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 933/1867] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:48.904019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d428-6f9f-4e23-8290-0ac7be680f33 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.904019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d428-6f9f-4e23-8290-0ac7be680f33 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.904019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584d428-6f9f-4e23-8290-0ac7be680f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.908509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:48.914223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5b44-9690-4bce-a578-3c38648e76cb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:48.921330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea51ec-17e3-4dfc-8c52-388acb32140a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:48.922057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea51ec-17e3-4dfc-8c52-388acb32140a service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:48.922343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea51ec-17e3-4dfc-8c52-388acb32140a service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:48.922618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea51ec-17e3-4dfc-8c52-388acb32140a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:48.945781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a584d428-6f9f-4e23-8290-0ac7be680f33 None None] MFA Rules not processed for user `7e43d9fc96064192a4b9f69242f1edbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:48.945781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a584d428-6f9f-4e23-8290-0ac7be680f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:48.968454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:49.020803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:49.062476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea51ec-17e3-4dfc-8c52-388acb32140a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:49.064286 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea51ec-17e3-4dfc-8c52-388acb32140a service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:49.072169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 934/1868] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:49.074079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584d428-6f9f-4e23-8290-0ac7be680f33 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:49.075653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 935/1869] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:49.075763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a584d428-6f9f-4e23-8290-0ac7be680f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.076531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea51ec-17e3-4dfc-8c52-388acb32140a service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:49.077802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-43ea51ec-17e3-4dfc-8c52-388acb32140a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.091853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea51ec-17e3-4dfc-8c52-388acb32140a service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:49.094573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584d428-6f9f-4e23-8290-0ac7be680f33 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:49.098232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0789bf9-ad09-435d-bb0a-d30959f0ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:49.099488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789bf9-ad09-435d-bb0a-d30959f0ab1b admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.099891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789bf9-ad09-435d-bb0a-d30959f0ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.100166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789bf9-ad09-435d-bb0a-d30959f0ab1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.100867 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0789bf9-ad09-435d-bb0a-d30959f0ab1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:49.101655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:49.102471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.102763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.103069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0789bf9-ad09-435d-bb0a-d30959f0ab1b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:49.103176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] PATH_INFO: `/v3/users/ace80bd0b1eb407a8bc919db10c2f649` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.106574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace80bd0b1eb407a8bc919db10c2f649)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:49.109760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:49.186314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:49.262526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 936/1870] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:49 2022] POST /identity/v3/projects => generated 409 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:49.263865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6828f-81b0-4a07-a70c-9cdb6f120353 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.264173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6828f-81b0-4a07-a70c-9cdb6f120353 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.264451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6828f-81b0-4a07-a70c-9cdb6f120353 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.265958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 937/1871] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:14:49.266668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6828f-81b0-4a07-a70c-9cdb6f120353 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:49.275135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b2b6828f-81b0-4a07-a70c-9cdb6f120353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.364763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6828f-81b0-4a07-a70c-9cdb6f120353 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:49.369863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cc629-7eba-4515-8a88-23311ca85932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:49.374079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cc629-7eba-4515-8a88-23311ca85932 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.374079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cc629-7eba-4515-8a88-23311ca85932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.374079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cc629-7eba-4515-8a88-23311ca85932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.374079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d85cc629-7eba-4515-8a88-23311ca85932 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.411043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace80bd0b1eb407a8bc919db10c2f649'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.420637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace80bd0b1eb407a8bc919db10c2f649'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.421658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace80bd0b1eb407a8bc919db10c2f649'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.437525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace80bd0b1eb407a8bc919db10c2f649'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.441276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cc629-7eba-4515-8a88-23311ca85932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:49.442888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cc629-7eba-4515-8a88-23311ca85932 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:49.459054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:49.459273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 938/1872] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:49.459273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cc629-7eba-4515-8a88-23311ca85932 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:49.525574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cc629-7eba-4515-8a88-23311ca85932 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:49.529475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-25404a64-7371-4e80-b13d-434094467c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace80bd0b1eb407a8bc919db10c2f649'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.536706 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 935/1873] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:49 2022] DELETE /identity/v3/users/ace80bd0b1eb407a8bc919db10c2f649 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:49.536840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16f00-5a4d-4b67-ab5d-d6213587a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:49.537259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16f00-5a4d-4b67-ab5d-d6213587a31a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.537546 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16f00-5a4d-4b67-ab5d-d6213587a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.537825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16f00-5a4d-4b67-ab5d-d6213587a31a admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.539263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d16f00-5a4d-4b67-ab5d-d6213587a31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:49.540737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d16f00-5a4d-4b67-ab5d-d6213587a31a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:49.541318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f37e-c5d4-4636-959e-623e9d931627 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.541702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f37e-c5d4-4636-959e-623e9d931627 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.542216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f37e-c5d4-4636-959e-623e9d931627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.560256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ab77f37e-c5d4-4636-959e-623e9d931627 None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:49.564957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab77f37e-c5d4-4636-959e-623e9d931627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.619571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 939/1874] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:49 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:49.621531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7bdfd-fda1-4868-9b6d-34b9ddbbb6dc None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.621822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7bdfd-fda1-4868-9b6d-34b9ddbbb6dc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.622105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7bdfd-fda1-4868-9b6d-34b9ddbbb6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.639443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c3b7bdfd-fda1-4868-9b6d-34b9ddbbb6dc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:49.640693 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c3b7bdfd-fda1-4868-9b6d-34b9ddbbb6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.640935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 936/1875] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:49.641827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f37e-c5d4-4636-959e-623e9d931627 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:49.643368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab77f37e-c5d4-4636-959e-623e9d931627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.707070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 940/1876] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:49.707070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7bdfd-fda1-4868-9b6d-34b9ddbbb6dc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:49.707070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c3b7bdfd-fda1-4868-9b6d-34b9ddbbb6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.714772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f37e-c5d4-4636-959e-623e9d931627 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:49.719437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:49.720337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.720740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.720938 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] PATH_INFO: `/v3/projects/ee57a9c5a56241b782b6808b9c8fcb9e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.722198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee57a9c5a56241b782b6808b9c8fcb9e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:49.724127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:49.724229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7bdfd-fda1-4868-9b6d-34b9ddbbb6dc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:49.728881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830f485-6a13-47a4-be0c-cb95ad087b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:49.730111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830f485-6a13-47a4-be0c-cb95ad087b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.730382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830f485-6a13-47a4-be0c-cb95ad087b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.730653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830f485-6a13-47a4-be0c-cb95ad087b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.731385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830f485-6a13-47a4-be0c-cb95ad087b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:49.733014 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830f485-6a13-47a4-be0c-cb95ad087b84 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:49.746929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 941/1877] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:49.746929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830f485-6a13-47a4-be0c-cb95ad087b84 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:49.748340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d830f485-6a13-47a4-be0c-cb95ad087b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.764606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830f485-6a13-47a4-be0c-cb95ad087b84 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:49.770139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf521fa-fb17-4573-8305-37d71037cb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:49.770812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf521fa-fb17-4573-8305-37d71037cb90 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:49.771095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf521fa-fb17-4573-8305-37d71037cb90 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:49.771376 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf521fa-fb17-4573-8305-37d71037cb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:49.781271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf521fa-fb17-4573-8305-37d71037cb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:49.782872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf521fa-fb17-4573-8305-37d71037cb90 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:49.794258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 942/1878] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:49.795048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf521fa-fb17-4573-8305-37d71037cb90 service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:49.796431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fcf521fa-fb17-4573-8305-37d71037cb90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:49.840862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee57a9c5a56241b782b6808b9c8fcb9e', 'request_id': 'req-ce52c292-cf81-4743-b46d-156675d92df5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.857477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:49.862008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf521fa-fb17-4573-8305-37d71037cb90 service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:49.923108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee57a9c5a56241b782b6808b9c8fcb9e', 'request_id': 'req-ce52c292-cf81-4743-b46d-156675d92df5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.930325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee57a9c5a56241b782b6808b9c8fcb9e', 'request_id': 'req-ce52c292-cf81-4743-b46d-156675d92df5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.944391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] The token cache is being invalidate because project ee57a9c5a56241b782b6808b9c8fcb9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:49.944683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.945384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:49.947218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 937/1879] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:49 2022] DELETE /identity/v3/projects/ee57a9c5a56241b782b6808b9c8fcb9e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:49.947776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:49.949304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:50.043904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52c292-cf81-4743-b46d-156675d92df5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:50.050869 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c71ca9-7249-4f2d-96b5-c50ec67e4cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:50.051946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c71ca9-7249-4f2d-96b5-c50ec67e4cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:50.053599 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c71ca9-7249-4f2d-96b5-c50ec67e4cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:50.054476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c71ca9-7249-4f2d-96b5-c50ec67e4cce admin admin] PATH_INFO: `/v3/projects/d134b7e5034f4441b4cf5f91e6c4eed3/users/0279275a179a459691fee8382533d617/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:50.063978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:50.064665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:50.064951 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:50.068638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:50.068638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:50.077711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c71ca9-7249-4f2d-96b5-c50ec67e4cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d134b7e5034f4441b4cf5f91e6c4eed3, user_id=0279275a179a459691fee8382533d617, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:50.081749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c71ca9-7249-4f2d-96b5-c50ec67e4cce admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:50.082723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:50.084260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:50.130526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 943/1880] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:50.131405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:50.134850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:50.156302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1695eec-f89f-498e-8580-7a9b6de2be9c service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:50.162166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:50.163410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:50.163575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:50.164111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] PATH_INFO: `/v3/users/e81cfdba11014ca992204f9971ea4a02` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:50.165434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81cfdba11014ca992204f9971ea4a02)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:50.168458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:50.219389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 938/1881] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:49 2022] PUT /identity/v3/projects/d134b7e5034f4441b4cf5f91e6c4eed3/users/0279275a179a459691fee8382533d617/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:50.225191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c71ca9-7249-4f2d-96b5-c50ec67e4cce admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:50.314771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c71ca9-7249-4f2d-96b5-c50ec67e4cce admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:50.319554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a847d3-b55f-42b0-8c6c-05ef78d90da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:50.320255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a847d3-b55f-42b0-8c6c-05ef78d90da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:50.320545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a847d3-b55f-42b0-8c6c-05ef78d90da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:50.320837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a847d3-b55f-42b0-8c6c-05ef78d90da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:50.321707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a847d3-b55f-42b0-8c6c-05ef78d90da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:50.324013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a847d3-b55f-42b0-8c6c-05ef78d90da3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:50.337977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 939/1882] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:50.343990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a847d3-b55f-42b0-8c6c-05ef78d90da3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:50.354423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a847d3-b55f-42b0-8c6c-05ef78d90da3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:50.364491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede97e3-a970-4280-8fb9-026a5e65e962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:50.365626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede97e3-a970-4280-8fb9-026a5e65e962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:50.365911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede97e3-a970-4280-8fb9-026a5e65e962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:50.366191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede97e3-a970-4280-8fb9-026a5e65e962 admin admin] PATH_INFO: `/v3/projects/d134b7e5034f4441b4cf5f91e6c4eed3/users/0279275a179a459691fee8382533d617/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:50.368414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede97e3-a970-4280-8fb9-026a5e65e962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d134b7e5034f4441b4cf5f91e6c4eed3, user_id=0279275a179a459691fee8382533d617, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:50.372433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede97e3-a970-4280-8fb9-026a5e65e962 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:50.389541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 940/1883] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:50 2022] PUT /identity/v3/projects/d134b7e5034f4441b4cf5f91e6c4eed3/users/0279275a179a459691fee8382533d617/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:50.409733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0b988-1755-41e0-adec-50b64cc98718 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:50.410393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0b988-1755-41e0-adec-50b64cc98718 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:50.410805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0b988-1755-41e0-adec-50b64cc98718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:50.416490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81cfdba11014ca992204f9971ea4a02'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:50.427231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81cfdba11014ca992204f9971ea4a02'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:50.445762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-70d0b988-1755-41e0-adec-50b64cc98718 None None] MFA Rules not processed for user `0279275a179a459691fee8382533d617`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:50.447109 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-70d0b988-1755-41e0-adec-50b64cc98718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:50.499567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81cfdba11014ca992204f9971ea4a02'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:50.501066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81cfdba11014ca992204f9971ea4a02'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:50.543836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81cfdba11014ca992204f9971ea4a02'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:50.559665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 944/1884] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:50 2022] DELETE /identity/v3/users/e81cfdba11014ca992204f9971ea4a02 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:50.566011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 941/1885] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:50.579454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:50.580827 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:50.652867 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c61157-7ace-4d43-9bb1-369dcc6fa3d3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:50.657157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:50.658097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:50.659108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:50.659414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:50.661844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:50.705892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:50.759355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:50.764236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:50.788694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 945/1886] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:51.155151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0b988-1755-41e0-adec-50b64cc98718 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:51.157081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-70d0b988-1755-41e0-adec-50b64cc98718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:51.220684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0b988-1755-41e0-adec-50b64cc98718 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:51.225035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:51.225965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:51.226683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:51.227075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:51.229023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:51.293075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:51.294144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:51.294528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:51.295663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:51.310557 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 942/1887] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:51.381941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:51.383434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:51.395989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5428fca-25a4-4f1f-87b1-86bf014aef2b service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:51.400050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e07c-a9a2-47b5-ac27-b4ed43396c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:51.400369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eed486-8fd6-41be-b04e-0d7b394317b9 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:51.400930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e07c-a9a2-47b5-ac27-b4ed43396c96 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:51.401254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e07c-a9a2-47b5-ac27-b4ed43396c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:51.402175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e07c-a9a2-47b5-ac27-b4ed43396c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:51.404098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-59f4e07c-a9a2-47b5-ac27-b4ed43396c96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:51.404181 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:51.408392 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:51.413535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:51.413535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:51.413535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] PATH_INFO: `/v3/projects/2e4eec4831604ad5ad1058b0eca31c8b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:51.413535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e4eec4831604ad5ad1058b0eca31c8b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:51.414071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:51.478700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e07c-a9a2-47b5-ac27-b4ed43396c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:51.481194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e07c-a9a2-47b5-ac27-b4ed43396c96 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:51.501856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 943/1888] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:51.539957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e4eec4831604ad5ad1058b0eca31c8b', 'request_id': 'req-062e4fc6-d9df-4227-b46c-b3485981bddb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:51.544888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e4eec4831604ad5ad1058b0eca31c8b', 'request_id': 'req-062e4fc6-d9df-4227-b46c-b3485981bddb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:51.551459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e4eec4831604ad5ad1058b0eca31c8b', 'request_id': 'req-062e4fc6-d9df-4227-b46c-b3485981bddb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:51.608511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] The token cache is being invalidate because project 2e4eec4831604ad5ad1058b0eca31c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:51.608959 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:51.609668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-062e4fc6-d9df-4227-b46c-b3485981bddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:51.611715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 946/1889] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:51 2022] DELETE /identity/v3/projects/2e4eec4831604ad5ad1058b0eca31c8b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:51.616803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eeff9-a343-4569-a5b3-1a6b57d6a1b7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:51.617623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eeff9-a343-4569-a5b3-1a6b57d6a1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:51.618055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18eeff9-a343-4569-a5b3-1a6b57d6a1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:51.637046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e18eeff9-a343-4569-a5b3-1a6b57d6a1b7 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:51.638236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e18eeff9-a343-4569-a5b3-1a6b57d6a1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:51.702632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 944/1890] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:51.710676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd5bc3-fb42-4b36-b78b-ff643e5319ac None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:51.716533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd5bc3-fb42-4b36-b78b-ff643e5319ac None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:51.717008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd5bc3-fb42-4b36-b78b-ff643e5319ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:51.747550 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-71fd5bc3-fb42-4b36-b78b-ff643e5319ac None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:51.749235 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-71fd5bc3-fb42-4b36-b78b-ff643e5319ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:51.767532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 947/1891] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:51.769519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eeff9-a343-4569-a5b3-1a6b57d6a1b7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:51.781428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18eeff9-a343-4569-a5b3-1a6b57d6a1b7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:51.787646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140ec30-2aa0-404b-89c9-1d9959a2894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:51.788406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140ec30-2aa0-404b-89c9-1d9959a2894d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:51.788692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140ec30-2aa0-404b-89c9-1d9959a2894d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:51.789508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140ec30-2aa0-404b-89c9-1d9959a2894d admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:51.791069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140ec30-2aa0-404b-89c9-1d9959a2894d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:51.791391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140ec30-2aa0-404b-89c9-1d9959a2894d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:51.797865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140ec30-2aa0-404b-89c9-1d9959a2894d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:51.817243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 945/1892] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:14:51.818770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd5bc3-fb42-4b36-b78b-ff643e5319ac None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:51.828939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd5bc3-fb42-4b36-b78b-ff643e5319ac None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:51.834187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207270e-ebb9-499e-8329-255ad9438a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:51.834939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207270e-ebb9-499e-8329-255ad9438a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:51.840343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207270e-ebb9-499e-8329-255ad9438a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:51.841009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207270e-ebb9-499e-8329-255ad9438a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:51.843132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207270e-ebb9-499e-8329-255ad9438a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:51.846240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207270e-ebb9-499e-8329-255ad9438a5d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:51.954891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 948/1893] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:51 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:51.956891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140ec30-2aa0-404b-89c9-1d9959a2894d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:51.969017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140ec30-2aa0-404b-89c9-1d9959a2894d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:52.033590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbdff9-3717-4ecf-a5fb-f1e517d99cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:52.034521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbdff9-3717-4ecf-a5fb-f1e517d99cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:52.034805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbdff9-3717-4ecf-a5fb-f1e517d99cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:52.035272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbdff9-3717-4ecf-a5fb-f1e517d99cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:52.036774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbdff9-3717-4ecf-a5fb-f1e517d99cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:52.039235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbdff9-3717-4ecf-a5fb-f1e517d99cd3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:52.145924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 946/1894] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:51 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:52.147445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207270e-ebb9-499e-8329-255ad9438a5d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:52.162756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207270e-ebb9-499e-8329-255ad9438a5d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:52.174748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b47591-508a-42c9-81fc-7e5db806a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:52.174748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b47591-508a-42c9-81fc-7e5db806a7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:52.174748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b47591-508a-42c9-81fc-7e5db806a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:52.174748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b47591-508a-42c9-81fc-7e5db806a7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:52.175242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b47591-508a-42c9-81fc-7e5db806a7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:52.176083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b47591-508a-42c9-81fc-7e5db806a7c3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:52.210705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 949/1895] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:52.216238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbdff9-3717-4ecf-a5fb-f1e517d99cd3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:52.231085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbdff9-3717-4ecf-a5fb-f1e517d99cd3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:52.237462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195e8b5-5cbd-407e-99b4-e22fe715744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:52.238283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195e8b5-5cbd-407e-99b4-e22fe715744b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:52.238679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195e8b5-5cbd-407e-99b4-e22fe715744b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:52.239067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195e8b5-5cbd-407e-99b4-e22fe715744b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:52.240187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195e8b5-5cbd-407e-99b4-e22fe715744b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:52.245707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195e8b5-5cbd-407e-99b4-e22fe715744b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:52.256951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 947/1896] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:52.263293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b47591-508a-42c9-81fc-7e5db806a7c3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:52.290988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b47591-508a-42c9-81fc-7e5db806a7c3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:52.302532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e62ff-1185-4b00-8ee1-5c946e5f7d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:52.304035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e62ff-1185-4b00-8ee1-5c946e5f7d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:52.304430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e62ff-1185-4b00-8ee1-5c946e5f7d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:52.304916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e62ff-1185-4b00-8ee1-5c946e5f7d47 admin admin] PATH_INFO: `/v3/projects/1f18bde4c1914c359642029bad7f6d62/users/01812aceb0384f95ad455a13768822ae/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:52.333894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e62ff-1185-4b00-8ee1-5c946e5f7d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f18bde4c1914c359642029bad7f6d62, user_id=01812aceb0384f95ad455a13768822ae, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:52.338420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e62ff-1185-4b00-8ee1-5c946e5f7d47 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:52.440454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 950/1897] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:52 2022] PUT /identity/v3/projects/1f18bde4c1914c359642029bad7f6d62/users/01812aceb0384f95ad455a13768822ae/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:52.442531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302082c8-3b14-40fd-bf21-6d6a8c92d269 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:52.442866 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302082c8-3b14-40fd-bf21-6d6a8c92d269 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:52.443151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302082c8-3b14-40fd-bf21-6d6a8c92d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:52.477757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-302082c8-3b14-40fd-bf21-6d6a8c92d269 None None] MFA Rules not processed for user `01812aceb0384f95ad455a13768822ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:52.478968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-302082c8-3b14-40fd-bf21-6d6a8c92d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:52.563864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e62ff-1185-4b00-8ee1-5c946e5f7d47 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:52.565065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-191e62ff-1185-4b00-8ee1-5c946e5f7d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:52.585861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:52.590925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 948/1898] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:52.592299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302082c8-3b14-40fd-bf21-6d6a8c92d269 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:52.637424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:52.694541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302082c8-3b14-40fd-bf21-6d6a8c92d269 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:52.700871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1db18-ca22-48f4-be23-976c3a859307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:52.701572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1db18-ca22-48f4-be23-976c3a859307 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:52.701861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1db18-ca22-48f4-be23-976c3a859307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:52.702142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1db18-ca22-48f4-be23-976c3a859307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:52.702883 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1db18-ca22-48f4-be23-976c3a859307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:52.704857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e62ff-1185-4b00-8ee1-5c946e5f7d47 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:52.704976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1db18-ca22-48f4-be23-976c3a859307 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:52.709661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:52.710660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:52.710954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:52.711236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] PATH_INFO: `/v3/projects/ab5a88a3627846d59ff20e8b09c62f3a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:52.712496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5a88a3627846d59ff20e8b09c62f3a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:52.715017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:52.821517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 949/1899] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:52 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:52.826213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1db18-ca22-48f4-be23-976c3a859307 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:52.890120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5a88a3627846d59ff20e8b09c62f3a', 'request_id': 'req-205f5636-ff52-4569-ba52-84f5663502fd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:52.896783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5a88a3627846d59ff20e8b09c62f3a', 'request_id': 'req-205f5636-ff52-4569-ba52-84f5663502fd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:52.907280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5a88a3627846d59ff20e8b09c62f3a', 'request_id': 'req-205f5636-ff52-4569-ba52-84f5663502fd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:52.915810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1db18-ca22-48f4-be23-976c3a859307 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:52.987694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5750d6-6de8-4c4a-889a-2834579d95b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:52.988450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5750d6-6de8-4c4a-889a-2834579d95b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:52.988730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5750d6-6de8-4c4a-889a-2834579d95b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:52.989098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5750d6-6de8-4c4a-889a-2834579d95b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:52.990142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5750d6-6de8-4c4a-889a-2834579d95b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:52.992349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5750d6-6de8-4c4a-889a-2834579d95b1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:53.036537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] The token cache is being invalidate because project ab5a88a3627846d59ff20e8b09c62f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:53.036898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:53.037558 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:53.039304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 951/1900] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:52 2022] DELETE /identity/v3/projects/ab5a88a3627846d59ff20e8b09c62f3a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:53.043144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:53.044498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:53.056805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f5636-ff52-4569-ba52-84f5663502fd admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:53.061848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:53.062617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:53.062896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:53.063417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] PATH_INFO: `/v3/users/caf252debdd84d26bb0bf8cb6992f248` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:53.064635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf252debdd84d26bb0bf8cb6992f248)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:53.066560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:53.116847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 950/1901] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:52 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:53.120787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5750d6-6de8-4c4a-889a-2834579d95b1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:53.122360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ce5750d6-6de8-4c4a-889a-2834579d95b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:53.134651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5750d6-6de8-4c4a-889a-2834579d95b1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:53.140019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b525b9-090a-4132-914a-81783933e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:53.140692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b525b9-090a-4132-914a-81783933e70f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:53.141089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b525b9-090a-4132-914a-81783933e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:53.141372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b525b9-090a-4132-914a-81783933e70f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:53.142105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b525b9-090a-4132-914a-81783933e70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:53.143727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b525b9-090a-4132-914a-81783933e70f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:53.154963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 951/1902] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:53.159793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b525b9-090a-4132-914a-81783933e70f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:53.173185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b525b9-090a-4132-914a-81783933e70f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:53.178452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825d4a9-c2dd-4229-99db-457b2a30b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:53.179345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825d4a9-c2dd-4229-99db-457b2a30b983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:53.179653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825d4a9-c2dd-4229-99db-457b2a30b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:53.179954 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825d4a9-c2dd-4229-99db-457b2a30b983 admin admin] PATH_INFO: `/v3/projects/b1bbcc67da484dc4a36492d81f955a68/users/222d116385c34ea98485f6460c5b96d3/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:53.201662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825d4a9-c2dd-4229-99db-457b2a30b983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bbcc67da484dc4a36492d81f955a68, user_id=222d116385c34ea98485f6460c5b96d3, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:53.204972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825d4a9-c2dd-4229-99db-457b2a30b983 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:53.279528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 952/1903] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:53 2022] PUT /identity/v3/projects/b1bbcc67da484dc4a36492d81f955a68/users/222d116385c34ea98485f6460c5b96d3/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:53.282461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825d4a9-c2dd-4229-99db-457b2a30b983 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:53.301388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf252debdd84d26bb0bf8cb6992f248'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:53.319904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf252debdd84d26bb0bf8cb6992f248'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:53.379715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825d4a9-c2dd-4229-99db-457b2a30b983 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:53.385395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6500db-f067-46aa-80e2-e6b68def8c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:53.386356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6500db-f067-46aa-80e2-e6b68def8c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:53.387391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6500db-f067-46aa-80e2-e6b68def8c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:53.387391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6500db-f067-46aa-80e2-e6b68def8c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:53.388052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6500db-f067-46aa-80e2-e6b68def8c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:53.389957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6500db-f067-46aa-80e2-e6b68def8c89 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:53.410581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 953/1904] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:53.412421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6500db-f067-46aa-80e2-e6b68def8c89 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:53.413953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf252debdd84d26bb0bf8cb6992f248'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:53.415026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf252debdd84d26bb0bf8cb6992f248'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:53.423423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6500db-f067-46aa-80e2-e6b68def8c89 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:53.428878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36dc2d-3e90-4aba-a508-247a4b306798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:53.430310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36dc2d-3e90-4aba-a508-247a4b306798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:53.430740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36dc2d-3e90-4aba-a508-247a4b306798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:53.431033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36dc2d-3e90-4aba-a508-247a4b306798 admin admin] PATH_INFO: `/v3/projects/b1bbcc67da484dc4a36492d81f955a68/users/222d116385c34ea98485f6460c5b96d3/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:53.433080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0256800f-6f1b-4c41-8679-1e3ac71624c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf252debdd84d26bb0bf8cb6992f248'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:53.433271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36dc2d-3e90-4aba-a508-247a4b306798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bbcc67da484dc4a36492d81f955a68, user_id=222d116385c34ea98485f6460c5b96d3, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:53.436950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36dc2d-3e90-4aba-a508-247a4b306798 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:53.441479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 952/1905] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:53 2022] DELETE /identity/v3/users/caf252debdd84d26bb0bf8cb6992f248 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:53.452618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 954/1906] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:53 2022] PUT /identity/v3/projects/b1bbcc67da484dc4a36492d81f955a68/users/222d116385c34ea98485f6460c5b96d3/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:53.470713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1cff0-551b-40ba-ba74-ca1708ba154c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:53.471018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1cff0-551b-40ba-ba74-ca1708ba154c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:53.471847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1cff0-551b-40ba-ba74-ca1708ba154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:53.502109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b1f1cff0-551b-40ba-ba74-ca1708ba154c None None] MFA Rules not processed for user `222d116385c34ea98485f6460c5b96d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:53.503333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b1f1cff0-551b-40ba-ba74-ca1708ba154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:53.584623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 953/1907] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:53.616919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36dc2d-3e90-4aba-a508-247a4b306798 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:53.619377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6c36dc2d-3e90-4aba-a508-247a4b306798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:53.684748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36dc2d-3e90-4aba-a508-247a4b306798 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:53.689240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc5a8f-8d93-45f8-bf75-e7e516b27351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:53.704447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5a8f-8d93-45f8-bf75-e7e516b27351 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:53.704447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5a8f-8d93-45f8-bf75-e7e516b27351 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:53.704447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5a8f-8d93-45f8-bf75-e7e516b27351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:53.704447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc5a8f-8d93-45f8-bf75-e7e516b27351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:53.704447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc5a8f-8d93-45f8-bf75-e7e516b27351 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:53.726445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 955/1908] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:53.864121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1cff0-551b-40ba-ba74-ca1708ba154c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:53.868401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b1f1cff0-551b-40ba-ba74-ca1708ba154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:53.878509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:53.976734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1cff0-551b-40ba-ba74-ca1708ba154c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:53.982016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:53.982897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:53.983178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:53.983483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] PATH_INFO: `/v3/users/01812aceb0384f95ad455a13768822ae` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:53.984725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01812aceb0384f95ad455a13768822ae)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:53.986663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:54.135119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc5a8f-8d93-45f8-bf75-e7e516b27351 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:54.139624 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1ebc5a8f-8d93-45f8-bf75-e7e516b27351 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:54.158623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc5a8f-8d93-45f8-bf75-e7e516b27351 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:54.164369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:54.165245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.165605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.165930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] PATH_INFO: `/v3/projects/dee2f925d8d14fada1793d17e2576a94` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.167919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee2f925d8d14fada1793d17e2576a94)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:54.169937 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:54.200583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01812aceb0384f95ad455a13768822ae'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.207575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01812aceb0384f95ad455a13768822ae'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.207948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:54.258848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee2f925d8d14fada1793d17e2576a94', 'request_id': 'req-0a25b665-717b-41d8-8d95-167bb2d29d83'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.265713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01812aceb0384f95ad455a13768822ae'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.266332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01812aceb0384f95ad455a13768822ae'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.279369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e93838b8-55d0-4984-991a-e29056f57b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01812aceb0384f95ad455a13768822ae'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.285237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 954/1909] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:53 2022] DELETE /identity/v3/users/01812aceb0384f95ad455a13768822ae => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:54.289542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f546ed-3e6f-4823-9215-0612af833822 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.289848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f546ed-3e6f-4823-9215-0612af833822 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.290108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f546ed-3e6f-4823-9215-0612af833822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.307122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-44f546ed-3e6f-4823-9215-0612af833822 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:54.310970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-44f546ed-3e6f-4823-9215-0612af833822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:54.321841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee2f925d8d14fada1793d17e2576a94', 'request_id': 'req-0a25b665-717b-41d8-8d95-167bb2d29d83'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.329931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee2f925d8d14fada1793d17e2576a94', 'request_id': 'req-0a25b665-717b-41d8-8d95-167bb2d29d83'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.342549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] The token cache is being invalidate because project dee2f925d8d14fada1793d17e2576a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:54.342850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.351339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a25b665-717b-41d8-8d95-167bb2d29d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:54.353359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 956/1910] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:54 2022] DELETE /identity/v3/projects/dee2f925d8d14fada1793d17e2576a94 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:54.358780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2918235-7890-406f-993e-aada344c79f7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.358993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2918235-7890-406f-993e-aada344c79f7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.359641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2918235-7890-406f-993e-aada344c79f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.373438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 955/1911] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:54.378941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e2918235-7890-406f-993e-aada344c79f7 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:54.380023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e2918235-7890-406f-993e-aada344c79f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:54.389428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 957/1912] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:54.394681 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f546ed-3e6f-4823-9215-0612af833822 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:54.396760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-44f546ed-3e6f-4823-9215-0612af833822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:54.396872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2534-5161-4e86-a68d-bdbc47a1981f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.397172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2534-5161-4e86-a68d-bdbc47a1981f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.402453 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2534-5161-4e86-a68d-bdbc47a1981f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.418899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dd6b2534-5161-4e86-a68d-bdbc47a1981f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:54.420142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dd6b2534-5161-4e86-a68d-bdbc47a1981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:54.431982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 958/1913] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:54.433838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2534-5161-4e86-a68d-bdbc47a1981f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:54.443973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2534-5161-4e86-a68d-bdbc47a1981f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:54.449284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0695e-3f2e-48e0-ae13-2bc1838b55e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:54.449962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0695e-3f2e-48e0-ae13-2bc1838b55e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.450456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0695e-3f2e-48e0-ae13-2bc1838b55e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.450566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0695e-3f2e-48e0-ae13-2bc1838b55e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.451238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0695e-3f2e-48e0-ae13-2bc1838b55e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:54.451548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0695e-3f2e-48e0-ae13-2bc1838b55e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:54.453194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0695e-3f2e-48e0-ae13-2bc1838b55e4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:54.465372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f546ed-3e6f-4823-9215-0612af833822 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:54.471210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 959/1914] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:14:54.471460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dcbe-7d74-4d61-ba1b-b978121f487b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:54.471460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dcbe-7d74-4d61-ba1b-b978121f487b service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.471638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0695e-3f2e-48e0-ae13-2bc1838b55e4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:54.471722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dcbe-7d74-4d61-ba1b-b978121f487b service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.471722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dcbe-7d74-4d61-ba1b-b978121f487b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.480498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0695e-3f2e-48e0-ae13-2bc1838b55e4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:54.480631 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528dcbe-7d74-4d61-ba1b-b978121f487b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:54.482009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528dcbe-7d74-4d61-ba1b-b978121f487b service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:54.482753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:54.486697 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78480d-a088-4008-bb2e-bd361d9684a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:54.487344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78480d-a088-4008-bb2e-bd361d9684a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.487639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78480d-a088-4008-bb2e-bd361d9684a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.487925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78480d-a088-4008-bb2e-bd361d9684a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.488629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78480d-a088-4008-bb2e-bd361d9684a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:54.494802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78480d-a088-4008-bb2e-bd361d9684a0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:54.494916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 956/1915] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:54.529377 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:54.566909 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 960/1916] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:54 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:54.570749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dcbe-7d74-4d61-ba1b-b978121f487b service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:54.582157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dcbe-7d74-4d61-ba1b-b978121f487b service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:54.664636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf278b7-225b-42f3-bc13-c383e512c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:54.665388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf278b7-225b-42f3-bc13-c383e512c260 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.665737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf278b7-225b-42f3-bc13-c383e512c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.666022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf278b7-225b-42f3-bc13-c383e512c260 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.667634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf278b7-225b-42f3-bc13-c383e512c260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:54.669405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf278b7-225b-42f3-bc13-c383e512c260 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:54.757994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 957/1917] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:54 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:54.759005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78480d-a088-4008-bb2e-bd361d9684a0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:54.774232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78480d-a088-4008-bb2e-bd361d9684a0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:54.783152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69de36-c9fd-457a-bb10-ab581b4b55cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:54.783986 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69de36-c9fd-457a-bb10-ab581b4b55cb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.784349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69de36-c9fd-457a-bb10-ab581b4b55cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.784703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69de36-c9fd-457a-bb10-ab581b4b55cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.785551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69de36-c9fd-457a-bb10-ab581b4b55cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:54.787384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69de36-c9fd-457a-bb10-ab581b4b55cb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:54.810812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 961/1918] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:54.811146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf278b7-225b-42f3-bc13-c383e512c260 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:54.817064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf278b7-225b-42f3-bc13-c383e512c260 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:54.821860 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db995902-6e10-49cc-8c0e-c5f595912369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:54.822524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db995902-6e10-49cc-8c0e-c5f595912369 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.823316 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db995902-6e10-49cc-8c0e-c5f595912369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.824277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db995902-6e10-49cc-8c0e-c5f595912369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.824733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db995902-6e10-49cc-8c0e-c5f595912369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:54.826356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db995902-6e10-49cc-8c0e-c5f595912369 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:54.841487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 958/1919] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:54.842644 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69de36-c9fd-457a-bb10-ab581b4b55cb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:54.853581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69de36-c9fd-457a-bb10-ab581b4b55cb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:54.861721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd76c0-8501-4bcd-9572-368ecd5cf3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:54.863130 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd76c0-8501-4bcd-9572-368ecd5cf3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:54.863415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd76c0-8501-4bcd-9572-368ecd5cf3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:54.863708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd76c0-8501-4bcd-9572-368ecd5cf3f1 admin admin] PATH_INFO: `/v3/projects/0421a97a9a9a49f6a30261e214355565/users/de1ba85c257741419951318b847e5a27/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:54.892991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd76c0-8501-4bcd-9572-368ecd5cf3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0421a97a9a9a49f6a30261e214355565, user_id=de1ba85c257741419951318b847e5a27, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:54.895600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd76c0-8501-4bcd-9572-368ecd5cf3f1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:55.017173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 962/1920] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:54 2022] PUT /identity/v3/projects/0421a97a9a9a49f6a30261e214355565/users/de1ba85c257741419951318b847e5a27/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:55.022053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d21bb0-25db-4fc5-a2d8-ad63373aaeb7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.022464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d21bb0-25db-4fc5-a2d8-ad63373aaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.022756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d21bb0-25db-4fc5-a2d8-ad63373aaeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.058078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b5d21bb0-25db-4fc5-a2d8-ad63373aaeb7 None None] MFA Rules not processed for user `de1ba85c257741419951318b847e5a27`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:55.060221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b5d21bb0-25db-4fc5-a2d8-ad63373aaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:55.139288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 959/1921] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:55.144502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd76c0-8501-4bcd-9572-368ecd5cf3f1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:55.188881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d21bb0-25db-4fc5-a2d8-ad63373aaeb7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:55.194486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b5d21bb0-25db-4fc5-a2d8-ad63373aaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:55.228323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd76c0-8501-4bcd-9572-368ecd5cf3f1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:55.235190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c098-4770-422b-9a62-0348df62dca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:55.236216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c098-4770-422b-9a62-0348df62dca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.237029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c098-4770-422b-9a62-0348df62dca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.237459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21c098-4770-422b-9a62-0348df62dca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.238218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c098-4770-422b-9a62-0348df62dca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:55.240682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21c098-4770-422b-9a62-0348df62dca8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:55.289020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d21bb0-25db-4fc5-a2d8-ad63373aaeb7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:55.295109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:55.296235 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.297170 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.297170 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] PATH_INFO: `/v3/projects/1f18bde4c1914c359642029bad7f6d62` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.298270 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f18bde4c1914c359642029bad7f6d62)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:55.300377 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:55.348524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 963/1922] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:55 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:55.352652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c098-4770-422b-9a62-0348df62dca8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:55.425353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21c098-4770-422b-9a62-0348df62dca8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:55.432244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f18bde4c1914c359642029bad7f6d62', 'request_id': 'req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.440016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f18bde4c1914c359642029bad7f6d62', 'request_id': 'req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.446502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f18bde4c1914c359642029bad7f6d62', 'request_id': 'req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.493482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7f4d3-51cd-4d65-8389-2a8982f1a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:55.494184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7f4d3-51cd-4d65-8389-2a8982f1a267 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.494465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7f4d3-51cd-4d65-8389-2a8982f1a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.494772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7f4d3-51cd-4d65-8389-2a8982f1a267 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.495568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7f4d3-51cd-4d65-8389-2a8982f1a267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:55.497653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7f4d3-51cd-4d65-8389-2a8982f1a267 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:55.523772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] The token cache is being invalidate because project 1f18bde4c1914c359642029bad7f6d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:55.524424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.525280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.531143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 960/1923] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:55 2022] DELETE /identity/v3/projects/1f18bde4c1914c359642029bad7f6d62 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:55.535182 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:55.536823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:55.551934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa47f5f-e03f-4bd5-8853-89ecfd7669bc admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:55.559089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 964/1924] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:55 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:55.561158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7f4d3-51cd-4d65-8389-2a8982f1a267 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:55.561852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:55.563534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.563842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1bc7f4d3-51cd-4d65-8389-2a8982f1a267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:55.564310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.565550 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] PATH_INFO: `/v3/users/222d116385c34ea98485f6460c5b96d3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.567164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] RBAC: Authorizing `identity:delete_user(user_id=222d116385c34ea98485f6460c5b96d3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:55.569174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:55.579079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7f4d3-51cd-4d65-8389-2a8982f1a267 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:55.584182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba791-2d25-40ed-b67d-f0e3437d21e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:55.584859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba791-2d25-40ed-b67d-f0e3437d21e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.585149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba791-2d25-40ed-b67d-f0e3437d21e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.585430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ba791-2d25-40ed-b67d-f0e3437d21e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.586407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ba791-2d25-40ed-b67d-f0e3437d21e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:55.588058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ba791-2d25-40ed-b67d-f0e3437d21e2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:55.593390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:55.610180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 965/1925] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:55.611398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba791-2d25-40ed-b67d-f0e3437d21e2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:55.625836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ba791-2d25-40ed-b67d-f0e3437d21e2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:55.632344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b09a-fe52-4ba4-8f76-825c652ce8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:55.633350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b09a-fe52-4ba4-8f76-825c652ce8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.634288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b09a-fe52-4ba4-8f76-825c652ce8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.634802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b09a-fe52-4ba4-8f76-825c652ce8c8 admin admin] PATH_INFO: `/v3/projects/08edd66bf6994b378be322f3c8339802/users/dce528961be94da9a30e36a7401836a5/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.652262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2b09a-fe52-4ba4-8f76-825c652ce8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08edd66bf6994b378be322f3c8339802, user_id=dce528961be94da9a30e36a7401836a5, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:55.654829 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2b09a-fe52-4ba4-8f76-825c652ce8c8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:55.779983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 966/1926] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:55 2022] PUT /identity/v3/projects/08edd66bf6994b378be322f3c8339802/users/dce528961be94da9a30e36a7401836a5/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:55.787191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b09a-fe52-4ba4-8f76-825c652ce8c8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:55.827152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222d116385c34ea98485f6460c5b96d3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.837632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222d116385c34ea98485f6460c5b96d3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.838273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:55.858551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b09a-fe52-4ba4-8f76-825c652ce8c8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:55.863621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58465253-40d0-48db-a6ac-db46b09d852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:55.864394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465253-40d0-48db-a6ac-db46b09d852b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.864745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465253-40d0-48db-a6ac-db46b09d852b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.865028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58465253-40d0-48db-a6ac-db46b09d852b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.865762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58465253-40d0-48db-a6ac-db46b09d852b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:55.867407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58465253-40d0-48db-a6ac-db46b09d852b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:55.879787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 967/1927] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:55.882395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58465253-40d0-48db-a6ac-db46b09d852b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:55.893585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58465253-40d0-48db-a6ac-db46b09d852b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:55.899505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48f6c0-3938-4920-8609-bcfc9d7798e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:55.900554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48f6c0-3938-4920-8609-bcfc9d7798e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.906852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48f6c0-3938-4920-8609-bcfc9d7798e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.906852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48f6c0-3938-4920-8609-bcfc9d7798e5 admin admin] PATH_INFO: `/v3/projects/08edd66bf6994b378be322f3c8339802/users/dce528961be94da9a30e36a7401836a5/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.906852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48f6c0-3938-4920-8609-bcfc9d7798e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08edd66bf6994b378be322f3c8339802, user_id=dce528961be94da9a30e36a7401836a5, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:55.906852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48f6c0-3938-4920-8609-bcfc9d7798e5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:55.926524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 968/1928] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:55 2022] PUT /identity/v3/projects/08edd66bf6994b378be322f3c8339802/users/dce528961be94da9a30e36a7401836a5/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:55.936128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222d116385c34ea98485f6460c5b96d3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.936263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a9b4d-b30c-4f87-9a45-2016356597bd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:55.936263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a9b4d-b30c-4f87-9a45-2016356597bd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:55.936263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a9b4d-b30c-4f87-9a45-2016356597bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:55.936451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222d116385c34ea98485f6460c5b96d3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.957128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222d116385c34ea98485f6460c5b96d3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:55.970455 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5d6a9b4d-b30c-4f87-9a45-2016356597bd None None] MFA Rules not processed for user `dce528961be94da9a30e36a7401836a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:55.975529 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d6a9b4d-b30c-4f87-9a45-2016356597bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:55.975640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 961/1929] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:55 2022] DELETE /identity/v3/users/222d116385c34ea98485f6460c5b96d3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:56.113833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 969/1930] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:56.125207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:56.126865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:56.194021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ce29c-ec1a-471e-8f44-ff70f47dbfac admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:56.197625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956562bd-8ec6-4dbc-a3ed-87e3522097cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:56.199074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956562bd-8ec6-4dbc-a3ed-87e3522097cf service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:56.199512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956562bd-8ec6-4dbc-a3ed-87e3522097cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:56.200074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956562bd-8ec6-4dbc-a3ed-87e3522097cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:56.209107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956562bd-8ec6-4dbc-a3ed-87e3522097cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:56.210595 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956562bd-8ec6-4dbc-a3ed-87e3522097cf service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:56.221899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 962/1931] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:56.568204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:56.591268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:56.673232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a9b4d-b30c-4f87-9a45-2016356597bd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:56.674804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d6a9b4d-b30c-4f87-9a45-2016356597bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:56.754926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a9b4d-b30c-4f87-9a45-2016356597bd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:56.761303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:56.762168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:56.762450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:56.762726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] PATH_INFO: `/v3/projects/b1bbcc67da484dc4a36492d81f955a68` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:56.763982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1bbcc67da484dc4a36492d81f955a68)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:56.765890 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:56.847955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:56.889185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1bbcc67da484dc4a36492d81f955a68', 'request_id': 'req-7d2e8a9d-cb60-426e-9704-5a5b85173282'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:56.979368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1bbcc67da484dc4a36492d81f955a68', 'request_id': 'req-7d2e8a9d-cb60-426e-9704-5a5b85173282'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:56.986075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1bbcc67da484dc4a36492d81f955a68', 'request_id': 'req-7d2e8a9d-cb60-426e-9704-5a5b85173282'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:56.996527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] The token cache is being invalidate because project b1bbcc67da484dc4a36492d81f955a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:56.996816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:56.997440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7d2e8a9d-cb60-426e-9704-5a5b85173282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:56.998993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 970/1932] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:56 2022] DELETE /identity/v3/projects/b1bbcc67da484dc4a36492d81f955a68 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:57.003942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d971b-d014-4c3e-bb6f-4d7e55ca2938 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.004390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d971b-d014-4c3e-bb6f-4d7e55ca2938 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.004507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d971b-d014-4c3e-bb6f-4d7e55ca2938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.012010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:57.028450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a24d971b-d014-4c3e-bb6f-4d7e55ca2938 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:57.030075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a24d971b-d014-4c3e-bb6f-4d7e55ca2938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:57.094183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 963/1933] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:57.101918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222eda-ba29-4265-859a-564d9eda2004 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.102159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222eda-ba29-4265-859a-564d9eda2004 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.102469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222eda-ba29-4265-859a-564d9eda2004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.121216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9f222eda-ba29-4265-859a-564d9eda2004 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:57.122442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9f222eda-ba29-4265-859a-564d9eda2004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:57.131102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 971/1934] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:57.135037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d971b-d014-4c3e-bb6f-4d7e55ca2938 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:57.147180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d971b-d014-4c3e-bb6f-4d7e55ca2938 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:57.152171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eda45-9e95-4b9a-b2cc-7102ec8104fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:57.152845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eda45-9e95-4b9a-b2cc-7102ec8104fb admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.153154 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eda45-9e95-4b9a-b2cc-7102ec8104fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.153431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eda45-9e95-4b9a-b2cc-7102ec8104fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.154165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eda45-9e95-4b9a-b2cc-7102ec8104fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:14:57.154506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eda45-9e95-4b9a-b2cc-7102ec8104fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:57.156166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eda45-9e95-4b9a-b2cc-7102ec8104fb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:57.169719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 964/1935] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:14:57.174100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f222eda-ba29-4265-859a-564d9eda2004 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:57.185250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f222eda-ba29-4265-859a-564d9eda2004 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:57.191705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06153231-04f8-462a-ba21-cd89d41ab0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:57.192414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06153231-04f8-462a-ba21-cd89d41ab0ff admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.192700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06153231-04f8-462a-ba21-cd89d41ab0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.192978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06153231-04f8-462a-ba21-cd89d41ab0ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.193702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06153231-04f8-462a-ba21-cd89d41ab0ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:57.195734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06153231-04f8-462a-ba21-cd89d41ab0ff admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:57.303906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 972/1936] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:57 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:57.306203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eda45-9e95-4b9a-b2cc-7102ec8104fb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:57.318221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eda45-9e95-4b9a-b2cc-7102ec8104fb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:57.350691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06153231-04f8-462a-ba21-cd89d41ab0ff admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:57.352469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-06153231-04f8-462a-ba21-cd89d41ab0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:57.404254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:57.436302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8e8c5-8620-43e7-9117-f591baf13427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:57.442700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8e8c5-8620-43e7-9117-f591baf13427 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.442700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8e8c5-8620-43e7-9117-f591baf13427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.442700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8e8c5-8620-43e7-9117-f591baf13427 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.442700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8e8c5-8620-43e7-9117-f591baf13427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:57.442700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8e8c5-8620-43e7-9117-f591baf13427 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:57.459840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06153231-04f8-462a-ba21-cd89d41ab0ff admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:57.465177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:57.466045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.466327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.466606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] PATH_INFO: `/v3/users/75b32017834041e7a8c27224ef4aa618` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.467806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b32017834041e7a8c27224ef4aa618)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:57.469778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:57.505598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 965/1937] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:57 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:57.509887 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8e8c5-8620-43e7-9117-f591baf13427 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:57.534174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8e8c5-8620-43e7-9117-f591baf13427 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:57.534174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fe22a-6eab-40a3-9952-29812d12ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:57.534174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe22a-6eab-40a3-9952-29812d12ffad admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.534174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe22a-6eab-40a3-9952-29812d12ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.534499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe22a-6eab-40a3-9952-29812d12ffad admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.534499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fe22a-6eab-40a3-9952-29812d12ffad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:57.534499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fe22a-6eab-40a3-9952-29812d12ffad admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:57.544151 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 966/1938] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:57.548079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fe22a-6eab-40a3-9952-29812d12ffad admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:57.557875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fe22a-6eab-40a3-9952-29812d12ffad admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:57.562564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a22ec-728b-49a0-9049-a1981357d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:57.563546 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a22ec-728b-49a0-9049-a1981357d6bb admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.563831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a22ec-728b-49a0-9049-a1981357d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.564140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a22ec-728b-49a0-9049-a1981357d6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.564898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a22ec-728b-49a0-9049-a1981357d6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:57.566539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a22ec-728b-49a0-9049-a1981357d6bb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:57.577980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 967/1939] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:14:57.582051 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a22ec-728b-49a0-9049-a1981357d6bb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:57.592318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a22ec-728b-49a0-9049-a1981357d6bb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:57.597027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c5c19-50c1-4a64-9739-c179ac48a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:57.597890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c5c19-50c1-4a64-9739-c179ac48a48d admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.598175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c5c19-50c1-4a64-9739-c179ac48a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.598453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c5c19-50c1-4a64-9739-c179ac48a48d admin admin] PATH_INFO: `/v3/projects/3a8baa8f1e954bd096858d17a83db383/users/ebb1eb7baae04ab79e63f151c49cfdf2/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.613945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c5c19-50c1-4a64-9739-c179ac48a48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8baa8f1e954bd096858d17a83db383, user_id=ebb1eb7baae04ab79e63f151c49cfdf2, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:57.616757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c5c19-50c1-4a64-9739-c179ac48a48d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:57.738009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 968/1940] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:57 2022] PUT /identity/v3/projects/3a8baa8f1e954bd096858d17a83db383/users/ebb1eb7baae04ab79e63f151c49cfdf2/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:57.753509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4749658-88ad-43ee-ab26-bf145501b054 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.753509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4749658-88ad-43ee-ab26-bf145501b054 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.753509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4749658-88ad-43ee-ab26-bf145501b054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.783141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a4749658-88ad-43ee-ab26-bf145501b054 None None] MFA Rules not processed for user `ebb1eb7baae04ab79e63f151c49cfdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:57.784541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a4749658-88ad-43ee-ab26-bf145501b054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:57.789975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b32017834041e7a8c27224ef4aa618'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:57.797404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b32017834041e7a8c27224ef4aa618'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:57.798076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b32017834041e7a8c27224ef4aa618'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:57.811738 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b32017834041e7a8c27224ef4aa618'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:57.848891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 969/1941] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:14:57.853194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4749658-88ad-43ee-ab26-bf145501b054 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:57.905353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b32017834041e7a8c27224ef4aa618'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:57.906393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:57.912365 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 973/1942] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:57 2022] DELETE /identity/v3/users/75b32017834041e7a8c27224ef4aa618 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:57.913785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:57.915641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:57.920005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4749658-88ad-43ee-ab26-bf145501b054 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:57.976348 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22316995-0cb4-4c27-94af-bb1398506bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:57.977016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316995-0cb4-4c27-94af-bb1398506bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.977301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316995-0cb4-4c27-94af-bb1398506bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.977576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316995-0cb4-4c27-94af-bb1398506bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.978271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22316995-0cb4-4c27-94af-bb1398506bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:57.980168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2101a10-c79d-4752-83c4-17c062327d99 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:57.980300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22316995-0cb4-4c27-94af-bb1398506bc1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:57.985026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:57.985885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:57.986166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:57.986437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] PATH_INFO: `/v3/users/de1ba85c257741419951318b847e5a27` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:57.987665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de1ba85c257741419951318b847e5a27)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:57.989665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:58.088060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:58.135975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 970/1943] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:14:57 2022] POST /identity/v3/projects => generated 381 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:14:58.137531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aa5fe-6a97-40a7-b31e-e4961332edac None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.137825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aa5fe-6a97-40a7-b31e-e4961332edac None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.138104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aa5fe-6a97-40a7-b31e-e4961332edac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.157230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2a3aa5fe-6a97-40a7-b31e-e4961332edac None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:58.158429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2a3aa5fe-6a97-40a7-b31e-e4961332edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:58.217755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 971/1944] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:58.218760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3aa5fe-6a97-40a7-b31e-e4961332edac None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:58.220395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2a3aa5fe-6a97-40a7-b31e-e4961332edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:58.235912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3aa5fe-6a97-40a7-b31e-e4961332edac None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:58.236058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de1ba85c257741419951318b847e5a27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:58.239501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf2365-cbed-4fe3-8b0c-dd1db566c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:58.240324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf2365-cbed-4fe3-8b0c-dd1db566c2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.240727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf2365-cbed-4fe3-8b0c-dd1db566c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.241009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf2365-cbed-4fe3-8b0c-dd1db566c2b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.241735 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf2365-cbed-4fe3-8b0c-dd1db566c2b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:58.243782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf2365-cbed-4fe3-8b0c-dd1db566c2b1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:58.245597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de1ba85c257741419951318b847e5a27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:58.246369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de1ba85c257741419951318b847e5a27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:58.259776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de1ba85c257741419951318b847e5a27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:58.324333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 972/1945] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:14:58 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:14:58.325172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf2365-cbed-4fe3-8b0c-dd1db566c2b1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:58.327453 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de1ba85c257741419951318b847e5a27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:58.328976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:58.329880 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-43cf2365-cbed-4fe3-8b0c-dd1db566c2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:58.336276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 974/1946] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:57 2022] DELETE /identity/v3/users/de1ba85c257741419951318b847e5a27 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:58.337307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:58.339831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:58.391349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:58.408395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf2365-cbed-4fe3-8b0c-dd1db566c2b1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:58.462978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d8b02-a428-44c5-8cbe-0c840663ef54 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:58.476329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c04ba-fdb1-4f98-b6bf-9298683d977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:58.477301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c04ba-fdb1-4f98-b6bf-9298683d977c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.477592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c04ba-fdb1-4f98-b6bf-9298683d977c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.477870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c04ba-fdb1-4f98-b6bf-9298683d977c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.478616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c04ba-fdb1-4f98-b6bf-9298683d977c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:58.483802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c04ba-fdb1-4f98-b6bf-9298683d977c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:58.486892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b78db0-0ddd-4938-9a7f-b21553692542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:58.488094 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b78db0-0ddd-4938-9a7f-b21553692542 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.489266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b78db0-0ddd-4938-9a7f-b21553692542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.490022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b78db0-0ddd-4938-9a7f-b21553692542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.492481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-99b78db0-0ddd-4938-9a7f-b21553692542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:58.498445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 975/1947] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:58.498748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1922ef-0e55-448e-a625-e5629bfa766e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.498942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1922ef-0e55-448e-a625-e5629bfa766e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.502264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1922ef-0e55-448e-a625-e5629bfa766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.518514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b78db0-0ddd-4938-9a7f-b21553692542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:58.520006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b78db0-0ddd-4938-9a7f-b21553692542 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:58.525572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6e1922ef-0e55-448e-a625-e5629bfa766e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:58.528776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e1922ef-0e55-448e-a625-e5629bfa766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:58.536521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 973/1948] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:58.536521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b78db0-0ddd-4938-9a7f-b21553692542 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:58.542824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b78db0-0ddd-4938-9a7f-b21553692542 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:58.549757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 976/1949] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:58.549929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc475ad-c93e-423c-ac4d-54c2548f6a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:58.549929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc475ad-c93e-423c-ac4d-54c2548f6a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.549929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc475ad-c93e-423c-ac4d-54c2548f6a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.549929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc475ad-c93e-423c-ac4d-54c2548f6a4c admin admin] PATH_INFO: `/v3/projects/f75efe5ceb55401dbee8ec7362ba3fd0/users/e73c2efd5bc44d479396c0fcda6b4471/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.559026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1922ef-0e55-448e-a625-e5629bfa766e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:58.561673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e1922ef-0e55-448e-a625-e5629bfa766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:58.571391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc475ad-c93e-423c-ac4d-54c2548f6a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75efe5ceb55401dbee8ec7362ba3fd0, user_id=e73c2efd5bc44d479396c0fcda6b4471, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:58.576542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1922ef-0e55-448e-a625-e5629bfa766e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:58.576692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc475ad-c93e-423c-ac4d-54c2548f6a4c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:58.579527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df6fd-94a3-48fb-9ab6-bb5fba8ca686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:58.580679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df6fd-94a3-48fb-9ab6-bb5fba8ca686 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.581281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df6fd-94a3-48fb-9ab6-bb5fba8ca686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.581688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df6fd-94a3-48fb-9ab6-bb5fba8ca686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.595314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799df6fd-94a3-48fb-9ab6-bb5fba8ca686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:58.595314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799df6fd-94a3-48fb-9ab6-bb5fba8ca686 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:58.606813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 977/1950] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:14:58.649333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 974/1951] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:58 2022] PUT /identity/v3/projects/f75efe5ceb55401dbee8ec7362ba3fd0/users/e73c2efd5bc44d479396c0fcda6b4471/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:58.654123 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df6fd-94a3-48fb-9ab6-bb5fba8ca686 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:58.668698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df6fd-94a3-48fb-9ab6-bb5fba8ca686 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:58.671406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:58.752627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89450b6d-172c-4b07-b6e1-a8eb3178cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:58.753698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89450b6d-172c-4b07-b6e1-a8eb3178cf06 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.754175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89450b6d-172c-4b07-b6e1-a8eb3178cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.754718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89450b6d-172c-4b07-b6e1-a8eb3178cf06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.755849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89450b6d-172c-4b07-b6e1-a8eb3178cf06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:58.757895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89450b6d-172c-4b07-b6e1-a8eb3178cf06 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:58.770655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 978/1952] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:14:58.787995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc475ad-c93e-423c-ac4d-54c2548f6a4c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:58.800273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc475ad-c93e-423c-ac4d-54c2548f6a4c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:58.809675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e1f56-63c6-44ae-95ea-c0b5af61ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:58.810751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e1f56-63c6-44ae-95ea-c0b5af61ec7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.811086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e1f56-63c6-44ae-95ea-c0b5af61ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.811370 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e1f56-63c6-44ae-95ea-c0b5af61ec7b admin admin] PATH_INFO: `/v3/projects/f75efe5ceb55401dbee8ec7362ba3fd0/users/e73c2efd5bc44d479396c0fcda6b4471/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.813843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e1f56-63c6-44ae-95ea-c0b5af61ec7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75efe5ceb55401dbee8ec7362ba3fd0, user_id=e73c2efd5bc44d479396c0fcda6b4471, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:58.816797 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e1f56-63c6-44ae-95ea-c0b5af61ec7b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:58.829404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 975/1953] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:14:58 2022] PUT /identity/v3/projects/f75efe5ceb55401dbee8ec7362ba3fd0/users/e73c2efd5bc44d479396c0fcda6b4471/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:14:58.839288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4e893-bb76-40d5-804f-272d7e8a95fa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:58.839585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4e893-bb76-40d5-804f-272d7e8a95fa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:58.839904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4e893-bb76-40d5-804f-272d7e8a95fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:58.871289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-61f4e893-bb76-40d5-804f-272d7e8a95fa None None] MFA Rules not processed for user `e73c2efd5bc44d479396c0fcda6b4471`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:14:58.872579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-61f4e893-bb76-40d5-804f-272d7e8a95fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:58.894339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:58.973357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 979/1954] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:14:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:14:58.982089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e1f56-63c6-44ae-95ea-c0b5af61ec7b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:58.990363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c77e1f56-63c6-44ae-95ea-c0b5af61ec7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:59.057555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e1f56-63c6-44ae-95ea-c0b5af61ec7b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:59.061514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4979-5dae-4db6-9c16-598b756586b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:59.062171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4979-5dae-4db6-9c16-598b756586b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:59.062483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4979-5dae-4db6-9c16-598b756586b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:59.063006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f4979-5dae-4db6-9c16-598b756586b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:59.073615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f4979-5dae-4db6-9c16-598b756586b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:59.075069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f4979-5dae-4db6-9c16-598b756586b7 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:59.085838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 976/1955] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:14:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:14:59.107981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4e893-bb76-40d5-804f-272d7e8a95fa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:59.109854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-61f4e893-bb76-40d5-804f-272d7e8a95fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:59.207895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4e893-bb76-40d5-804f-272d7e8a95fa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:59.213007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:59.215118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:59.215411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:59.215726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] PATH_INFO: `/v3/projects/0421a97a9a9a49f6a30261e214355565` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:59.218555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0421a97a9a9a49f6a30261e214355565)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:59.218678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4979-5dae-4db6-9c16-598b756586b7 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:59.220058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ae1f4979-5dae-4db6-9c16-598b756586b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:59.220524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:59.243476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f4979-5dae-4db6-9c16-598b756586b7 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:59.252819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:59.252819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:59.252819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:59.252819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] PATH_INFO: `/v3/projects/907b3c649e3742288c024f90bde9c41c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:59.253195 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907b3c649e3742288c024f90bde9c41c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:59.255259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:59.324438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0421a97a9a9a49f6a30261e214355565', 'request_id': 'req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.350310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907b3c649e3742288c024f90bde9c41c', 'request_id': 'req-330f8ef8-6236-4990-a239-2ad96c2efb36'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.350853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:59.357246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907b3c649e3742288c024f90bde9c41c', 'request_id': 'req-330f8ef8-6236-4990-a239-2ad96c2efb36'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.363101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907b3c649e3742288c024f90bde9c41c', 'request_id': 'req-330f8ef8-6236-4990-a239-2ad96c2efb36'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.379113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0421a97a9a9a49f6a30261e214355565', 'request_id': 'req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.392033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0421a97a9a9a49f6a30261e214355565', 'request_id': 'req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.404148 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] The token cache is being invalidate because project 0421a97a9a9a49f6a30261e214355565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:59.412726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.412726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.412726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 980/1956] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:59 2022] DELETE /identity/v3/projects/0421a97a9a9a49f6a30261e214355565 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:59.415309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:59.421419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:59.459202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] The token cache is being invalidate because project 907b3c649e3742288c024f90bde9c41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:14:59.459558 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.460334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.464285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 977/1957] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:14:59 2022] DELETE /identity/v3/projects/907b3c649e3742288c024f90bde9c41c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:14:59.469517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:14:59.475086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:14:59.509174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d79b4-8bb8-4a96-a4cf-74873e531fa5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:59.509627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:59.576966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f8ef8-6236-4990-a239-2ad96c2efb36 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:14:59.583203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:59.584299 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:59.585256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:59.585554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] PATH_INFO: `/v3/users/7e43d9fc96064192a4b9f69242f1edbd` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:59.586875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e43d9fc96064192a4b9f69242f1edbd)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:59.589706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:59.596127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:14:59.597064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:14:59.597351 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:14:59.597769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] PATH_INFO: `/v3/users/dce528961be94da9a30e36a7401836a5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:14:59.599047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce528961be94da9a30e36a7401836a5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:14:59.602551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:14:59.840233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e43d9fc96064192a4b9f69242f1edbd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.842316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce528961be94da9a30e36a7401836a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.848735 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e43d9fc96064192a4b9f69242f1edbd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.849554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce528961be94da9a30e36a7401836a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.850271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce528961be94da9a30e36a7401836a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.869263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce528961be94da9a30e36a7401836a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.934140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:14:59.990380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e43d9fc96064192a4b9f69242f1edbd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:14:59.990996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e43d9fc96064192a4b9f69242f1edbd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.004943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e43d9fc96064192a4b9f69242f1edbd'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.011290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 978/1958] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:59 2022] DELETE /identity/v3/users/7e43d9fc96064192a4b9f69242f1edbd => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:00.012115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:00.013455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:00.026494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:00.059526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce528961be94da9a30e36a7401836a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.066918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 981/1959] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:14:59 2022] DELETE /identity/v3/users/dce528961be94da9a30e36a7401836a5 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:00.094669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa660e1-99eb-4da7-a751-8b12180a4b82 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:00.161723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:00.162628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:00.162915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:00.163848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] PATH_INFO: `/v3/users/ebb1eb7baae04ab79e63f151c49cfdf2` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:00.164944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb1eb7baae04ab79e63f151c49cfdf2)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:00.167627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:00.288020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:00.289620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:00.305789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492aa22-827a-4b68-bf7e-bc72d6ab66d5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:00.311571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:00.312624 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:00.313261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:00.313645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] PATH_INFO: `/v3/users/4cb9b358d3634691b632d64bf4f4db25` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:00.315015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb9b358d3634691b632d64bf4f4db25)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:00.317180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:00.321996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:00.368021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb1eb7baae04ab79e63f151c49cfdf2'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.376338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb1eb7baae04ab79e63f151c49cfdf2'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.447572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb1eb7baae04ab79e63f151c49cfdf2'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.448311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb1eb7baae04ab79e63f151c49cfdf2'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.461752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3395ee36-acf7-4859-82f9-47c40d1c6002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb1eb7baae04ab79e63f151c49cfdf2'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.468714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 979/1960] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:00 2022] DELETE /identity/v3/users/ebb1eb7baae04ab79e63f151c49cfdf2 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:00.472753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d0bd0-c476-43d8-9799-4be25d0c466b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:00.473042 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d0bd0-c476-43d8-9799-4be25d0c466b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:00.473319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d0bd0-c476-43d8-9799-4be25d0c466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:00.490902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-316d0bd0-c476-43d8-9799-4be25d0c466b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:00.492200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-316d0bd0-c476-43d8-9799-4be25d0c466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:00.996562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb9b358d3634691b632d64bf4f4db25'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.997690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 980/1961] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:00.998076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb9b358d3634691b632d64bf4f4db25'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.998076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb9b358d3634691b632d64bf4f4db25'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.998807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d0bd0-c476-43d8-9799-4be25d0c466b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:00.998807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-316d0bd0-c476-43d8-9799-4be25d0c466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:00.999318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb9b358d3634691b632d64bf4f4db25'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:00.999770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d0bd0-c476-43d8-9799-4be25d0c466b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:00.999770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a18a8-e408-4fca-a7db-735c45205a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:00.999770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a18a8-e408-4fca-a7db-735c45205a5d service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:00.999770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a18a8-e408-4fca-a7db-735c45205a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.001112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a18a8-e408-4fca-a7db-735c45205a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.001112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a18a8-e408-4fca-a7db-735c45205a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:01.001112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a18a8-e408-4fca-a7db-735c45205a5d service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:01.001112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 981/1962] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:01.001905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb9b358d3634691b632d64bf4f4db25'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.001905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 982/1963] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:00 2022] DELETE /identity/v3/users/4cb9b358d3634691b632d64bf4f4db25 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:01.002251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a18a8-e408-4fca-a7db-735c45205a5d service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:01.002251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f30a18a8-e408-4fca-a7db-735c45205a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:01.003189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:01.003189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:01.003403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a18a8-e408-4fca-a7db-735c45205a5d service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:01.052827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1dac4-c16b-421c-a54f-bf58133de976 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:01.055327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:01.056734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.058307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.058786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] PATH_INFO: `/v3/projects/02b42c3413d74804b048afe57cffa227` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.060454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b42c3413d74804b048afe57cffa227)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:01.062616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:01.069833 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:01.071408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.071842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.072441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] PATH_INFO: `/v3/projects/08edd66bf6994b378be322f3c8339802` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.075031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08edd66bf6994b378be322f3c8339802)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:01.077163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:01.122625 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:01.235096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b42c3413d74804b048afe57cffa227', 'request_id': 'req-23b9771d-02cd-4ac0-9531-52a879ac010d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.262589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08edd66bf6994b378be322f3c8339802', 'request_id': 'req-63f0723b-fe15-422c-bafa-d6828b2cc590'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.272238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08edd66bf6994b378be322f3c8339802', 'request_id': 'req-63f0723b-fe15-422c-bafa-d6828b2cc590'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.278554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08edd66bf6994b378be322f3c8339802', 'request_id': 'req-63f0723b-fe15-422c-bafa-d6828b2cc590'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.321808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b42c3413d74804b048afe57cffa227', 'request_id': 'req-23b9771d-02cd-4ac0-9531-52a879ac010d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.329607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b42c3413d74804b048afe57cffa227', 'request_id': 'req-23b9771d-02cd-4ac0-9531-52a879ac010d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.341194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] The token cache is being invalidate because project 02b42c3413d74804b048afe57cffa227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:01.341691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.342400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-23b9771d-02cd-4ac0-9531-52a879ac010d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.344712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 983/1964] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:00 2022] DELETE /identity/v3/projects/02b42c3413d74804b048afe57cffa227 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:01.345990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5566-5bfb-4129-a8f0-ca45f2931239 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.346278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5566-5bfb-4129-a8f0-ca45f2931239 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.346560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5566-5bfb-4129-a8f0-ca45f2931239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.367629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-992d5566-5bfb-4129-a8f0-ca45f2931239 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:01.368928 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-992d5566-5bfb-4129-a8f0-ca45f2931239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:01.414633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:01.431606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] The token cache is being invalidate because project 08edd66bf6994b378be322f3c8339802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:01.434324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.439482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63f0723b-fe15-422c-bafa-d6828b2cc590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:01.442073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 982/1965] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:00 2022] DELETE /identity/v3/projects/08edd66bf6994b378be322f3c8339802 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:01.443643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 984/1966] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:01.444321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df829756-eb96-4a39-bfdd-7240ce653acf None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.444923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df829756-eb96-4a39-bfdd-7240ce653acf None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.445435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df829756-eb96-4a39-bfdd-7240ce653acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.448515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfa465-a88f-4b2c-8975-c1c2e8b43c55 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.451740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfa465-a88f-4b2c-8975-c1c2e8b43c55 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.451740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfa465-a88f-4b2c-8975-c1c2e8b43c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.473085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fddfa465-a88f-4b2c-8975-c1c2e8b43c55 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:01.473813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fddfa465-a88f-4b2c-8975-c1c2e8b43c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:01.484615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 985/1967] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:01.485475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfa465-a88f-4b2c-8975-c1c2e8b43c55 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:01.490892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fddfa465-a88f-4b2c-8975-c1c2e8b43c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:01.511830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-df829756-eb96-4a39-bfdd-7240ce653acf None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:01.514890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-df829756-eb96-4a39-bfdd-7240ce653acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:01.534140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 983/1968] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:01.543073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ff45-a59c-4d2d-bdf2-aca20ef8a352 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.543470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ff45-a59c-4d2d-bdf2-aca20ef8a352 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.543890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5ff45-a59c-4d2d-bdf2-aca20ef8a352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.564843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-eca5ff45-a59c-4d2d-bdf2-aca20ef8a352 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:01.566515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-eca5ff45-a59c-4d2d-bdf2-aca20ef8a352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:01.566759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfa465-a88f-4b2c-8975-c1c2e8b43c55 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:01.570650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfa886-bba4-48bf-9cfd-9aeef56e2cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:01.571304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfa886-bba4-48bf-9cfd-9aeef56e2cad service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.571742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfa886-bba4-48bf-9cfd-9aeef56e2cad service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.572098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfa886-bba4-48bf-9cfd-9aeef56e2cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.576943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 984/1969] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:01.578374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e281-ea58-4c70-bd84-93fe93acbcf1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.578666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e281-ea58-4c70-bd84-93fe93acbcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.578940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e281-ea58-4c70-bd84-93fe93acbcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.585930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfa886-bba4-48bf-9cfd-9aeef56e2cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:01.587562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfa886-bba4-48bf-9cfd-9aeef56e2cad service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:01.599561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 986/1970] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:01.600554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfa886-bba4-48bf-9cfd-9aeef56e2cad service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:01.602902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2a21e281-ea58-4c70-bd84-93fe93acbcf1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:01.605415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2a21e281-ea58-4c70-bd84-93fe93acbcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:01.618603 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 985/1971] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:01.623145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfa886-bba4-48bf-9cfd-9aeef56e2cad service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:01.625012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e281-ea58-4c70-bd84-93fe93acbcf1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:01.638501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e281-ea58-4c70-bd84-93fe93acbcf1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:01.639295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431b334-baa1-4539-bb40-318254a80fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:01.640129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431b334-baa1-4539-bb40-318254a80fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.640718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431b334-baa1-4539-bb40-318254a80fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.641100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431b334-baa1-4539-bb40-318254a80fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.641941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431b334-baa1-4539-bb40-318254a80fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:01.642353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431b334-baa1-4539-bb40-318254a80fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:01.644104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431b334-baa1-4539-bb40-318254a80fb8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:01.645718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1235d-fbab-481d-8595-d847db51cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:01.646481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1235d-fbab-481d-8595-d847db51cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.646812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1235d-fbab-481d-8595-d847db51cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.647104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1235d-fbab-481d-8595-d847db51cd79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.648608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1235d-fbab-481d-8595-d847db51cd79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:01.648925 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1235d-fbab-481d-8595-d847db51cd79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:01.653137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1235d-fbab-481d-8595-d847db51cd79 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:01.667656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 987/1972] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:01.672739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431b334-baa1-4539-bb40-318254a80fb8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:01.686726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 986/1973] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:01.687493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431b334-baa1-4539-bb40-318254a80fb8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:01.689183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1235d-fbab-481d-8595-d847db51cd79 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:01.694989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabc6ad-818c-4c5c-90ea-07953a6bd610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:01.695779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabc6ad-818c-4c5c-90ea-07953a6bd610 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.699243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabc6ad-818c-4c5c-90ea-07953a6bd610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.699683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabc6ad-818c-4c5c-90ea-07953a6bd610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.701757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabc6ad-818c-4c5c-90ea-07953a6bd610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:01.705393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabc6ad-818c-4c5c-90ea-07953a6bd610 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:01.708276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1235d-fbab-481d-8595-d847db51cd79 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:01.720578 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b27676-b527-41e6-bda6-2a9d111515f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:01.721855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b27676-b527-41e6-bda6-2a9d111515f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.722243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b27676-b527-41e6-bda6-2a9d111515f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.724209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b27676-b527-41e6-bda6-2a9d111515f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.725168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b27676-b527-41e6-bda6-2a9d111515f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:01.729690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b27676-b527-41e6-bda6-2a9d111515f1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:01.821803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 988/1974] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:01 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:01.824220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabc6ad-818c-4c5c-90ea-07953a6bd610 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:01.826845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-acabc6ad-818c-4c5c-90ea-07953a6bd610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:01.861437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 987/1975] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:01 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:01.861437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b27676-b527-41e6-bda6-2a9d111515f1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:01.924981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabc6ad-818c-4c5c-90ea-07953a6bd610 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:01.956323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b27676-b527-41e6-bda6-2a9d111515f1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:01.962343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef18d3-8a52-4bbb-9c20-274cd67048e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:01.967695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef18d3-8a52-4bbb-9c20-274cd67048e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:01.967695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef18d3-8a52-4bbb-9c20-274cd67048e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:01.967695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef18d3-8a52-4bbb-9c20-274cd67048e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:01.967695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef18d3-8a52-4bbb-9c20-274cd67048e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:01.967695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef18d3-8a52-4bbb-9c20-274cd67048e7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.009654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.011786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.012912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.013279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] PATH_INFO: `/v3/projects/3a8baa8f1e954bd096858d17a83db383` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.014791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8baa8f1e954bd096858d17a83db383)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.017385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.074793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 988/1976] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:01 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:02.075597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef18d3-8a52-4bbb-9c20-274cd67048e7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.085311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef18d3-8a52-4bbb-9c20-274cd67048e7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:02.090293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2ee22-fac1-42f9-bc23-2bd0115dc5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.090937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2ee22-fac1-42f9-bc23-2bd0115dc5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.091217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2ee22-fac1-42f9-bc23-2bd0115dc5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.091532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2ee22-fac1-42f9-bc23-2bd0115dc5f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.092253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2ee22-fac1-42f9-bc23-2bd0115dc5f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.094171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2ee22-fac1-42f9-bc23-2bd0115dc5f5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.163642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8baa8f1e954bd096858d17a83db383', 'request_id': 'req-a0c3d900-ab10-40f2-b774-12d87a04e754'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.226902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8baa8f1e954bd096858d17a83db383', 'request_id': 'req-a0c3d900-ab10-40f2-b774-12d87a04e754'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.234392 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 989/1977] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:02 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:02.235438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2ee22-fac1-42f9-bc23-2bd0115dc5f5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.235754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8baa8f1e954bd096858d17a83db383', 'request_id': 'req-a0c3d900-ab10-40f2-b774-12d87a04e754'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.248383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2ee22-fac1-42f9-bc23-2bd0115dc5f5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:02.248747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] The token cache is being invalidate because project 3a8baa8f1e954bd096858d17a83db383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:02.249105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.249920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.254403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 989/1978] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:01 2022] DELETE /identity/v3/projects/3a8baa8f1e954bd096858d17a83db383 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:02.254403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.254403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:02.321402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f490b-f3f5-4fe1-ad13-d8b7d1214b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.322157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f490b-f3f5-4fe1-ad13-d8b7d1214b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.322996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f490b-f3f5-4fe1-ad13-d8b7d1214b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.323953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f490b-f3f5-4fe1-ad13-d8b7d1214b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.324781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f490b-f3f5-4fe1-ad13-d8b7d1214b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.326508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f490b-f3f5-4fe1-ad13-d8b7d1214b0f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.330899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d900-ab10-40f2-b774-12d87a04e754 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:02.337381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 990/1979] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:02.339531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f490b-f3f5-4fe1-ad13-d8b7d1214b0f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.341909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cf2f490b-f3f5-4fe1-ad13-d8b7d1214b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:02.342041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.342460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.342751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.343031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] PATH_INFO: `/v3/projects/19740d52aa5a4c818d181ab5808388e6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.344306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19740d52aa5a4c818d181ab5808388e6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.346302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.353898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f490b-f3f5-4fe1-ad13-d8b7d1214b0f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:02.359864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54972-83c1-480a-9a43-1c36a58823de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.360668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54972-83c1-480a-9a43-1c36a58823de admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.360953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54972-83c1-480a-9a43-1c36a58823de admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.361277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54972-83c1-480a-9a43-1c36a58823de admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.362014 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a54972-83c1-480a-9a43-1c36a58823de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.363663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a54972-83c1-480a-9a43-1c36a58823de admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.375642 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 991/1980] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:02.379647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54972-83c1-480a-9a43-1c36a58823de admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.381373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a5a54972-83c1-480a-9a43-1c36a58823de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:02.395794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54972-83c1-480a-9a43-1c36a58823de admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:02.401629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.402506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.402785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.403076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] PATH_INFO: `/v3/users/e73c2efd5bc44d479396c0fcda6b4471` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.404319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73c2efd5bc44d479396c0fcda6b4471)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.406429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.461861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19740d52aa5a4c818d181ab5808388e6', 'request_id': 'req-0673e3e1-8968-447c-b499-8864cc60d20a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.468855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:02.556148 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19740d52aa5a4c818d181ab5808388e6', 'request_id': 'req-0673e3e1-8968-447c-b499-8864cc60d20a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.563413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19740d52aa5a4c818d181ab5808388e6', 'request_id': 'req-0673e3e1-8968-447c-b499-8864cc60d20a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.575919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] The token cache is being invalidate because project 19740d52aa5a4c818d181ab5808388e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:02.576214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.576891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.578994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 990/1981] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:02 2022] DELETE /identity/v3/projects/19740d52aa5a4c818d181ab5808388e6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:02.580692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.588798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:02.623305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73c2efd5bc44d479396c0fcda6b4471'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.631387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73c2efd5bc44d479396c0fcda6b4471'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.651975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673e3e1-8968-447c-b499-8864cc60d20a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:02.656701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef18a1-bc0b-4225-95a1-f86f0afb863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.657471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef18a1-bc0b-4225-95a1-f86f0afb863a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.657751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef18a1-bc0b-4225-95a1-f86f0afb863a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.658029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef18a1-bc0b-4225-95a1-f86f0afb863a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.658767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef18a1-bc0b-4225-95a1-f86f0afb863a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.660536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef18a1-bc0b-4225-95a1-f86f0afb863a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.673399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 991/1982] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:02.674316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef18a1-bc0b-4225-95a1-f86f0afb863a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.676317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c5ef18a1-bc0b-4225-95a1-f86f0afb863a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:02.689721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef18a1-bc0b-4225-95a1-f86f0afb863a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:02.694736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad364a3-e79b-43d6-ba78-655fb1fca708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.695435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad364a3-e79b-43d6-ba78-655fb1fca708 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.695719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad364a3-e79b-43d6-ba78-655fb1fca708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.696051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad364a3-e79b-43d6-ba78-655fb1fca708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.696791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad364a3-e79b-43d6-ba78-655fb1fca708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.698909 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad364a3-e79b-43d6-ba78-655fb1fca708 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.709418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 992/1983] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:02.710337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad364a3-e79b-43d6-ba78-655fb1fca708 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.711744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:02.712117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cad364a3-e79b-43d6-ba78-655fb1fca708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:02.715523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73c2efd5bc44d479396c0fcda6b4471'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.715523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73c2efd5bc44d479396c0fcda6b4471'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.727710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad364a3-e79b-43d6-ba78-655fb1fca708 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:02.731599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73c2efd5bc44d479396c0fcda6b4471'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:02.734115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.744430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.744430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.744430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] PATH_INFO: `/v3/users/0279275a179a459691fee8382533d617` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.744430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0279275a179a459691fee8382533d617)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.744430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.744934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 992/1984] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:02 2022] DELETE /identity/v3/users/e73c2efd5bc44d479396c0fcda6b4471 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:02.744934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.744934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:02.847981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7336e-f978-4017-a6a2-0ee8136a7a6e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:02.856720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacc12b-1029-4a8f-a8a7-5cf431186f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:02.858339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacc12b-1029-4a8f-a8a7-5cf431186f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:02.858626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacc12b-1029-4a8f-a8a7-5cf431186f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:02.858904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacc12b-1029-4a8f-a8a7-5cf431186f63 admin admin] PATH_INFO: `/v3/projects/467b44c4c4a844e1bc7644549752ff8f/users/cfce6fc26be44ca49e99121220c36746/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:02.887024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacc12b-1029-4a8f-a8a7-5cf431186f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467b44c4c4a844e1bc7644549752ff8f, user_id=cfce6fc26be44ca49e99121220c36746, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:02.889941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacc12b-1029-4a8f-a8a7-5cf431186f63 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:02.969608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 993/1985] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:02 2022] PUT /identity/v3/projects/467b44c4c4a844e1bc7644549752ff8f/users/cfce6fc26be44ca49e99121220c36746/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:02.978615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacc12b-1029-4a8f-a8a7-5cf431186f63 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:02.978615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-efacc12b-1029-4a8f-a8a7-5cf431186f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:03.093035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0279275a179a459691fee8382533d617'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:03.094172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacc12b-1029-4a8f-a8a7-5cf431186f63 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:03.102351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232986c1-bae0-42e2-8c18-5f432d23b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:03.103278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232986c1-bae0-42e2-8c18-5f432d23b33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:03.103564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232986c1-bae0-42e2-8c18-5f432d23b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:03.104088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232986c1-bae0-42e2-8c18-5f432d23b33a admin admin] PATH_INFO: `/v3/projects/988d1fb31993424a80d5b7d07aa09bc1/users/afec7f67e45a4d3d824498fbc38f36b3/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:03.112293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0279275a179a459691fee8382533d617'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:03.114347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0279275a179a459691fee8382533d617'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:03.170481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232986c1-bae0-42e2-8c18-5f432d23b33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=988d1fb31993424a80d5b7d07aa09bc1, user_id=afec7f67e45a4d3d824498fbc38f36b3, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:03.178197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232986c1-bae0-42e2-8c18-5f432d23b33a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:03.188739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0279275a179a459691fee8382533d617'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:03.292402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 994/1986] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:02 2022] PUT /identity/v3/projects/988d1fb31993424a80d5b7d07aa09bc1/users/afec7f67e45a4d3d824498fbc38f36b3/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:03.294317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee50f0c-5e61-436f-8b4a-c50b7afe1630 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:03.295210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee50f0c-5e61-436f-8b4a-c50b7afe1630 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:03.295687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee50f0c-5e61-436f-8b4a-c50b7afe1630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:03.312411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-00438974-cccc-4355-b39b-a5d9b9c6df7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0279275a179a459691fee8382533d617'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:03.338125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 993/1987] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:02 2022] DELETE /identity/v3/users/0279275a179a459691fee8382533d617 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:03.361717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c76a-184d-43fa-ba0b-d98a51fe19c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:03.361717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c76a-184d-43fa-ba0b-d98a51fe19c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:03.361717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c76a-184d-43fa-ba0b-d98a51fe19c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:03.380685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0ee50f0c-5e61-436f-8b4a-c50b7afe1630 None None] MFA Rules not processed for user `cfce6fc26be44ca49e99121220c36746`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:03.381953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0ee50f0c-5e61-436f-8b4a-c50b7afe1630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:03.410864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c851c76a-184d-43fa-ba0b-d98a51fe19c0 None None] MFA Rules not processed for user `afec7f67e45a4d3d824498fbc38f36b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:03.412343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c851c76a-184d-43fa-ba0b-d98a51fe19c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:03.547295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 995/1988] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:03.550579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee50f0c-5e61-436f-8b4a-c50b7afe1630 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:03.550579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0ee50f0c-5e61-436f-8b4a-c50b7afe1630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:03.558334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 994/1989] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:03.559781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c76a-184d-43fa-ba0b-d98a51fe19c0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:03.561891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c851c76a-184d-43fa-ba0b-d98a51fe19c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:03.665446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c76a-184d-43fa-ba0b-d98a51fe19c0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:03.682782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4af9-13d4-4a0b-9a0d-24733ca7cbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:03.682782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4af9-13d4-4a0b-9a0d-24733ca7cbec admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:03.682782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4af9-13d4-4a0b-9a0d-24733ca7cbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:03.682782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4af9-13d4-4a0b-9a0d-24733ca7cbec admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:03.683792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4af9-13d4-4a0b-9a0d-24733ca7cbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:03.683792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4af9-13d4-4a0b-9a0d-24733ca7cbec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:03.685999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee50f0c-5e61-436f-8b4a-c50b7afe1630 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:03.691129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:03.692064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:03.693064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:03.693355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] PATH_INFO: `/v3/projects/f75efe5ceb55401dbee8ec7362ba3fd0` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:03.694605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75efe5ceb55401dbee8ec7362ba3fd0)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:03.697002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:03.716867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:03.783311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 995/1990] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:03 2022] POST /identity/v3/projects => generated 375 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:03.785792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4af9-13d4-4a0b-9a0d-24733ca7cbec admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:03.787989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-16ea4af9-13d4-4a0b-9a0d-24733ca7cbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:03.855975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75efe5ceb55401dbee8ec7362ba3fd0', 'request_id': 'req-b1624361-4726-481f-a41d-c51bb20389a8'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:03.862153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4af9-13d4-4a0b-9a0d-24733ca7cbec admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:03.863005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75efe5ceb55401dbee8ec7362ba3fd0', 'request_id': 'req-b1624361-4726-481f-a41d-c51bb20389a8'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:03.879986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75efe5ceb55401dbee8ec7362ba3fd0', 'request_id': 'req-b1624361-4726-481f-a41d-c51bb20389a8'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:03.919606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd99da0-dd10-48b9-98bd-0c8d96d08a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:03.920480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd99da0-dd10-48b9-98bd-0c8d96d08a85 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:03.920767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd99da0-dd10-48b9-98bd-0c8d96d08a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:03.921054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd99da0-dd10-48b9-98bd-0c8d96d08a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:03.921752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd99da0-dd10-48b9-98bd-0c8d96d08a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:03.923747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd99da0-dd10-48b9-98bd-0c8d96d08a85 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.042251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] The token cache is being invalidate because project f75efe5ceb55401dbee8ec7362ba3fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:04.042874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:04.043517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:04.045432 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 996/1991] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:03 2022] DELETE /identity/v3/projects/f75efe5ceb55401dbee8ec7362ba3fd0 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:04.046311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.046800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 996/1992] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:03 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:04.047734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.048183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd99da0-dd10-48b9-98bd-0c8d96d08a85 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.050663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6bd99da0-dd10-48b9-98bd-0c8d96d08a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.061471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1624361-4726-481f-a41d-c51bb20389a8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.127488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cb22e-7da4-4c1a-9622-2b7f5385cb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.128152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cb22e-7da4-4c1a-9622-2b7f5385cb42 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.129201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cb22e-7da4-4c1a-9622-2b7f5385cb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.129499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cb22e-7da4-4c1a-9622-2b7f5385cb42 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.132563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cb22e-7da4-4c1a-9622-2b7f5385cb42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.132563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cb22e-7da4-4c1a-9622-2b7f5385cb42 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.139685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:04.140726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd99da0-dd10-48b9-98bd-0c8d96d08a85 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.145635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.146506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.146792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.147070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] PATH_INFO: `/v3/projects/d134b7e5034f4441b4cf5f91e6c4eed3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.148294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d134b7e5034f4441b4cf5f91e6c4eed3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.150216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.224848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 997/1993] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:04.226274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1d99f-74f0-49cb-90fa-05c3ca05207b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.226560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1d99f-74f0-49cb-90fa-05c3ca05207b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.226834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1d99f-74f0-49cb-90fa-05c3ca05207b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.245669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-aff1d99f-74f0-49cb-90fa-05c3ca05207b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:04.246860 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aff1d99f-74f0-49cb-90fa-05c3ca05207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.254987 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd134b7e5034f4441b4cf5f91e6c4eed3', 'request_id': 'req-c98a2e2e-49a1-49f6-9214-1c13068a8603'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:04.306470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 998/1994] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:04.306470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1d99f-74f0-49cb-90fa-05c3ca05207b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.308570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aff1d99f-74f0-49cb-90fa-05c3ca05207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.320379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1d99f-74f0-49cb-90fa-05c3ca05207b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.326258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d172de-068f-46d5-a2ab-29e11648fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.326935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d172de-068f-46d5-a2ab-29e11648fb61 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.327225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d172de-068f-46d5-a2ab-29e11648fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.327503 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d172de-068f-46d5-a2ab-29e11648fb61 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.328375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d172de-068f-46d5-a2ab-29e11648fb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.330325 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d172de-068f-46d5-a2ab-29e11648fb61 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.349541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd134b7e5034f4441b4cf5f91e6c4eed3', 'request_id': 'req-c98a2e2e-49a1-49f6-9214-1c13068a8603'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:04.357412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd134b7e5034f4441b4cf5f91e6c4eed3', 'request_id': 'req-c98a2e2e-49a1-49f6-9214-1c13068a8603'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:04.367760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] The token cache is being invalidate because project d134b7e5034f4441b4cf5f91e6c4eed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:04.368080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:04.368754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:04.371042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 997/1995] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:04 2022] DELETE /identity/v3/projects/d134b7e5034f4441b4cf5f91e6c4eed3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:04.371804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.373114 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.386979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a2e2e-49a1-49f6-9214-1c13068a8603 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.390305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057fdc9-65ad-48b2-a6e1-1128b8a99fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.390951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057fdc9-65ad-48b2-a6e1-1128b8a99fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.391237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057fdc9-65ad-48b2-a6e1-1128b8a99fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.391517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057fdc9-65ad-48b2-a6e1-1128b8a99fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.392275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057fdc9-65ad-48b2-a6e1-1128b8a99fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.393950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057fdc9-65ad-48b2-a6e1-1128b8a99fe6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.407430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 998/1996] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:04.407430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1f21f-7248-4b87-8473-62559a3b8bea None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.407430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1f21f-7248-4b87-8473-62559a3b8bea None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.407430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1f21f-7248-4b87-8473-62559a3b8bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.425765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5bf1f21f-7248-4b87-8473-62559a3b8bea None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:04.426964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5bf1f21f-7248-4b87-8473-62559a3b8bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.435694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 999/1997] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:04.436996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cae5d8-2d3c-407e-a526-0486aa6bdc36 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.438626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cae5d8-2d3c-407e-a526-0486aa6bdc36 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.438626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cae5d8-2d3c-407e-a526-0486aa6bdc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.448443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 999/1998] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:04.449190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d172de-068f-46d5-a2ab-29e11648fb61 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.458808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d172de-068f-46d5-a2ab-29e11648fb61 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.459082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-22cae5d8-2d3c-407e-a526-0486aa6bdc36 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:04.460470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-22cae5d8-2d3c-407e-a526-0486aa6bdc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.463855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd72b4-edb8-4759-bc89-27219f179fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.464734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd72b4-edb8-4759-bc89-27219f179fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.465078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd72b4-edb8-4759-bc89-27219f179fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.465360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd72b4-edb8-4759-bc89-27219f179fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.466102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd72b4-edb8-4759-bc89-27219f179fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.467723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd72b4-edb8-4759-bc89-27219f179fd2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.470284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1000/1999] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:04.471284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cae5d8-2d3c-407e-a526-0486aa6bdc36 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.488066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1000/2000] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:04.488950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd72b4-edb8-4759-bc89-27219f179fd2 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.491966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bccd72b4-edb8-4759-bc89-27219f179fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.492280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cae5d8-2d3c-407e-a526-0486aa6bdc36 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.499247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145d22c-f1c7-41f9-8c08-894247d3fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.500027 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145d22c-f1c7-41f9-8c08-894247d3fe8c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.500378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145d22c-f1c7-41f9-8c08-894247d3fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.500781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145d22c-f1c7-41f9-8c08-894247d3fe8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.501585 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145d22c-f1c7-41f9-8c08-894247d3fe8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:04.501961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145d22c-f1c7-41f9-8c08-894247d3fe8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.504197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145d22c-f1c7-41f9-8c08-894247d3fe8c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.507182 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd72b4-edb8-4759-bc89-27219f179fd2 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.512954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50c69-9d64-46b7-8f71-7dd13d77e7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.513628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50c69-9d64-46b7-8f71-7dd13d77e7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.513911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50c69-9d64-46b7-8f71-7dd13d77e7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.514187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a50c69-9d64-46b7-8f71-7dd13d77e7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.515059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a50c69-9d64-46b7-8f71-7dd13d77e7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.516707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a50c69-9d64-46b7-8f71-7dd13d77e7c0 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.523165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1001/2001] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:04.524705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e3c3d-8ab3-4b04-a3ae-06e620a9caf3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.525156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e3c3d-8ab3-4b04-a3ae-06e620a9caf3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.525601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e3c3d-8ab3-4b04-a3ae-06e620a9caf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.531865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1001/2002] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:04.532882 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50c69-9d64-46b7-8f71-7dd13d77e7c0 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.548083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a50c69-9d64-46b7-8f71-7dd13d77e7c0 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.561306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80e315-3fda-45f6-b60b-4f075f356cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.561306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80e315-3fda-45f6-b60b-4f075f356cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.561306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80e315-3fda-45f6-b60b-4f075f356cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.561306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80e315-3fda-45f6-b60b-4f075f356cdb admin admin] PATH_INFO: `/v3/projects/5974bfa37f9547a6ac8e4ba6f2b43eb3/users/b70bc71dfe664b2bbe25b90eb8a371e2/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.562038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-aa5e3c3d-8ab3-4b04-a3ae-06e620a9caf3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:04.562038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-aa5e3c3d-8ab3-4b04-a3ae-06e620a9caf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.572218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1002/2003] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:04.572218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e3c3d-8ab3-4b04-a3ae-06e620a9caf3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.581284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e3c3d-8ab3-4b04-a3ae-06e620a9caf3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.582523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80e315-3fda-45f6-b60b-4f075f356cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5974bfa37f9547a6ac8e4ba6f2b43eb3, user_id=b70bc71dfe664b2bbe25b90eb8a371e2, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.586391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80e315-3fda-45f6-b60b-4f075f356cdb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.587216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4c2c2-9001-4c91-b9e4-449522e3cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.588022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4c2c2-9001-4c91-b9e4-449522e3cc96 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.589507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4c2c2-9001-4c91-b9e4-449522e3cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.589507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4c2c2-9001-4c91-b9e4-449522e3cc96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.590266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4c2c2-9001-4c91-b9e4-449522e3cc96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.592281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4c2c2-9001-4c91-b9e4-449522e3cc96 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.659909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1002/2004] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:04 2022] PUT /identity/v3/projects/5974bfa37f9547a6ac8e4ba6f2b43eb3/users/b70bc71dfe664b2bbe25b90eb8a371e2/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:04.660855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80e315-3fda-45f6-b60b-4f075f356cdb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.661144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1003/2005] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:04.665682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4c2c2-9001-4c91-b9e4-449522e3cc96 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.741200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80e315-3fda-45f6-b60b-4f075f356cdb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.744057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4c2c2-9001-4c91-b9e4-449522e3cc96 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.749407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a2b61-a1f8-4bb4-86d3-a98c97a772ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.750078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a2b61-a1f8-4bb4-86d3-a98c97a772ce admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.750365 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a2b61-a1f8-4bb4-86d3-a98c97a772ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.750639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a2b61-a1f8-4bb4-86d3-a98c97a772ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.751382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a2b61-a1f8-4bb4-86d3-a98c97a772ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:04.751747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a2b61-a1f8-4bb4-86d3-a98c97a772ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.753393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a2b61-a1f8-4bb4-86d3-a98c97a772ce admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.766326 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1004/2006] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:04.767130 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a2b61-a1f8-4bb4-86d3-a98c97a772ce admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.778494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a2b61-a1f8-4bb4-86d3-a98c97a772ce admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.783543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5021b-a77c-4223-9e1e-6ff6ae1d7a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.787327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5021b-a77c-4223-9e1e-6ff6ae1d7a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.787327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5021b-a77c-4223-9e1e-6ff6ae1d7a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.787327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5021b-a77c-4223-9e1e-6ff6ae1d7a92 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.787327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5021b-a77c-4223-9e1e-6ff6ae1d7a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.787792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5021b-a77c-4223-9e1e-6ff6ae1d7a92 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.801912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49e690-f88c-4b0b-a587-35be96758ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.802726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49e690-f88c-4b0b-a587-35be96758ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.803038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49e690-f88c-4b0b-a587-35be96758ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.803310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49e690-f88c-4b0b-a587-35be96758ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.804080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49e690-f88c-4b0b-a587-35be96758ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.805899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49e690-f88c-4b0b-a587-35be96758ae0 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.821862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1003/2007] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:04.821862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf207e4-32d9-453c-89ea-24dc67202b91 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.821862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf207e4-32d9-453c-89ea-24dc67202b91 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.821862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf207e4-32d9-453c-89ea-24dc67202b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.851104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5cf207e4-32d9-453c-89ea-24dc67202b91 None None] MFA Rules not processed for user `b70bc71dfe664b2bbe25b90eb8a371e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:04.852030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5cf207e4-32d9-453c-89ea-24dc67202b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:04.887917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1005/2008] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:04.891929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5021b-a77c-4223-9e1e-6ff6ae1d7a92 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.903030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5021b-a77c-4223-9e1e-6ff6ae1d7a92 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.908100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93e295-728a-4e94-9908-3ddbeb1533be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.908793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93e295-728a-4e94-9908-3ddbeb1533be admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.909198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93e295-728a-4e94-9908-3ddbeb1533be admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.909507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93e295-728a-4e94-9908-3ddbeb1533be admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.910204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93e295-728a-4e94-9908-3ddbeb1533be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.912203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93e295-728a-4e94-9908-3ddbeb1533be admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:04.929594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:04.949965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1004/2009] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:04.949965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf207e4-32d9-453c-89ea-24dc67202b91 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:04.960314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf207e4-32d9-453c-89ea-24dc67202b91 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:04.967658 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0db8-25f7-4c79-aff7-6c851252508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:04.968604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0db8-25f7-4c79-aff7-6c851252508e admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:04.968891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0db8-25f7-4c79-aff7-6c851252508e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:04.969168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b0db8-25f7-4c79-aff7-6c851252508e admin admin] PATH_INFO: `/v3/projects/90e4dac597d54ac99ae08751f2b5e982/users/33f345a716224a9ca46f05f0679a443a/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:04.991321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0db8-25f7-4c79-aff7-6c851252508e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e4dac597d54ac99ae08751f2b5e982, user_id=33f345a716224a9ca46f05f0679a443a, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:04.994053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b0db8-25f7-4c79-aff7-6c851252508e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.069083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1006/2010] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:04 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:05.070186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93e295-728a-4e94-9908-3ddbeb1533be admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.099132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1005/2011] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:04 2022] PUT /identity/v3/projects/90e4dac597d54ac99ae08751f2b5e982/users/33f345a716224a9ca46f05f0679a443a/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:05.102136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0db8-25f7-4c79-aff7-6c851252508e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.144275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93e295-728a-4e94-9908-3ddbeb1533be admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.200844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b0db8-25f7-4c79-aff7-6c851252508e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.205682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a95542-f28c-40fb-b9de-f65e4c92f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.206321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a95542-f28c-40fb-b9de-f65e4c92f2de admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.206604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a95542-f28c-40fb-b9de-f65e4c92f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.206880 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a95542-f28c-40fb-b9de-f65e4c92f2de admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.207696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a95542-f28c-40fb-b9de-f65e4c92f2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.210368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a95542-f28c-40fb-b9de-f65e4c92f2de admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.215860 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=8 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:05.216434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ecd5a-ef44-45e6-b653-91148d683051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.217180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ecd5a-ef44-45e6-b653-91148d683051 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.217448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ecd5a-ef44-45e6-b653-91148d683051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.217729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ecd5a-ef44-45e6-b653-91148d683051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.218466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ecd5a-ef44-45e6-b653-91148d683051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.220113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ecd5a-ef44-45e6-b653-91148d683051 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.234116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1007/2012] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:05.234116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ecd5a-ef44-45e6-b653-91148d683051 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.242740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ecd5a-ef44-45e6-b653-91148d683051 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.248796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542cdf0-ba4c-4604-8bb1-72d46cccfca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.249627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542cdf0-ba4c-4604-8bb1-72d46cccfca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.249924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542cdf0-ba4c-4604-8bb1-72d46cccfca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.250205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542cdf0-ba4c-4604-8bb1-72d46cccfca8 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.251071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542cdf0-ba4c-4604-8bb1-72d46cccfca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.253107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542cdf0-ba4c-4604-8bb1-72d46cccfca8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.299168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1006/2013] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:05 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:05.299168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d63c-8ce6-49cc-a0c5-49dfbab0f111 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.299168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d63c-8ce6-49cc-a0c5-49dfbab0f111 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.299168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d63c-8ce6-49cc-a0c5-49dfbab0f111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.326431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4bd2d63c-8ce6-49cc-a0c5-49dfbab0f111 None None] MFA Rules not processed for user `33f345a716224a9ca46f05f0679a443a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:05.327679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4bd2d63c-8ce6-49cc-a0c5-49dfbab0f111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:05.367579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1008/2014] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:05 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:05.369141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542cdf0-ba4c-4604-8bb1-72d46cccfca8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.380423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542cdf0-ba4c-4604-8bb1-72d46cccfca8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.405795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1007/2015] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:05.406703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d63c-8ce6-49cc-a0c5-49dfbab0f111 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.455739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac479d-e5cc-482c-ba92-b31494dddb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.456541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac479d-e5cc-482c-ba92-b31494dddb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.456913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac479d-e5cc-482c-ba92-b31494dddb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.457335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac479d-e5cc-482c-ba92-b31494dddb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.458036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac479d-e5cc-482c-ba92-b31494dddb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.459689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac479d-e5cc-482c-ba92-b31494dddb1a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.471130 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1009/2016] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:05.472826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac479d-e5cc-482c-ba92-b31494dddb1a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.477260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d63c-8ce6-49cc-a0c5-49dfbab0f111 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.483785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac479d-e5cc-482c-ba92-b31494dddb1a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.484093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9d756-ca0c-4510-9329-ce459f95b05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.484814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9d756-ca0c-4510-9329-ce459f95b05b admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.485095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9d756-ca0c-4510-9329-ce459f95b05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.485424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9d756-ca0c-4510-9329-ce459f95b05b admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.486135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9d756-ca0c-4510-9329-ce459f95b05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.488154 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9d756-ca0c-4510-9329-ce459f95b05b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.488886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf442add-0300-4384-af50-09f0b2af73ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.489539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442add-0300-4384-af50-09f0b2af73ed admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.489820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442add-0300-4384-af50-09f0b2af73ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.490096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf442add-0300-4384-af50-09f0b2af73ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.490826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf442add-0300-4384-af50-09f0b2af73ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.492516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf442add-0300-4384-af50-09f0b2af73ed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.507149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1010/2017] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:05.507149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf442add-0300-4384-af50-09f0b2af73ed admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.516155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf442add-0300-4384-af50-09f0b2af73ed admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.518765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:05.522812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd7184-471e-4102-81fe-19c19c71aef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.526063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd7184-471e-4102-81fe-19c19c71aef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.526063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd7184-471e-4102-81fe-19c19c71aef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.526063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd7184-471e-4102-81fe-19c19c71aef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.526063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd7184-471e-4102-81fe-19c19c71aef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.526765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd7184-471e-4102-81fe-19c19c71aef0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.550054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1008/2018] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:05 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:05.550930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9d756-ca0c-4510-9329-ce459f95b05b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.561077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9d756-ca0c-4510-9329-ce459f95b05b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.566169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd71c59-2f9c-4cf1-a949-216597eadd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.567231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd71c59-2f9c-4cf1-a949-216597eadd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.567677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd71c59-2f9c-4cf1-a949-216597eadd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.569055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:05.574430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd71c59-2f9c-4cf1-a949-216597eadd6e admin admin] PATH_INFO: `/v3/projects/63a2b70dd5d343beb6f9396bdebd9a6c/users/28332786f16c4396a64d4c0645081e86/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.584900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd71c59-2f9c-4cf1-a949-216597eadd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a2b70dd5d343beb6f9396bdebd9a6c, user_id=28332786f16c4396a64d4c0645081e86, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.587630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd71c59-2f9c-4cf1-a949-216597eadd6e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.614538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1011/2019] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:05 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:05.615502 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd7184-471e-4102-81fe-19c19c71aef0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.652999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1009/2020] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:05 2022] PUT /identity/v3/projects/63a2b70dd5d343beb6f9396bdebd9a6c/users/28332786f16c4396a64d4c0645081e86/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:05.653830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd71c59-2f9c-4cf1-a949-216597eadd6e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.678886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd7184-471e-4102-81fe-19c19c71aef0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.681980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:05.719529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd71c59-2f9c-4cf1-a949-216597eadd6e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.724294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87482ca-ca64-49d6-9abe-dacd1a7d9d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.724963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87482ca-ca64-49d6-9abe-dacd1a7d9d1b admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.725248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87482ca-ca64-49d6-9abe-dacd1a7d9d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.725528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87482ca-ca64-49d6-9abe-dacd1a7d9d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.726262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87482ca-ca64-49d6-9abe-dacd1a7d9d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.727894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87482ca-ca64-49d6-9abe-dacd1a7d9d1b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.736656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88bc6-a27a-4b51-a859-0a2879237275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.737320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88bc6-a27a-4b51-a859-0a2879237275 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.737605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88bc6-a27a-4b51-a859-0a2879237275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.737908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88bc6-a27a-4b51-a859-0a2879237275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.738635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88bc6-a27a-4b51-a859-0a2879237275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.739622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1010/2021] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:05.740294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88bc6-a27a-4b51-a859-0a2879237275 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.741122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87482ca-ca64-49d6-9abe-dacd1a7d9d1b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.751167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87482ca-ca64-49d6-9abe-dacd1a7d9d1b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.752573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1012/2022] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:05.753791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7091-6df5-47d6-9056-1a9f2f4717d8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.754083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7091-6df5-47d6-9056-1a9f2f4717d8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.754359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7091-6df5-47d6-9056-1a9f2f4717d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.759213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bdb08-213e-4789-8fab-0c7fb43e4c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.759906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bdb08-213e-4789-8fab-0c7fb43e4c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.760195 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bdb08-213e-4789-8fab-0c7fb43e4c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.760486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bdb08-213e-4789-8fab-0c7fb43e4c95 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.762085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bdb08-213e-4789-8fab-0c7fb43e4c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.763306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bdb08-213e-4789-8fab-0c7fb43e4c95 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.781591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-925f7091-6df5-47d6-9056-1a9f2f4717d8 None None] MFA Rules not processed for user `28332786f16c4396a64d4c0645081e86`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:05.782917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-925f7091-6df5-47d6-9056-1a9f2f4717d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:05.813253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:05.848647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1013/2023] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:05.849477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7091-6df5-47d6-9056-1a9f2f4717d8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.863481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7091-6df5-47d6-9056-1a9f2f4717d8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.868583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6acde6-d5a3-4e00-aeaf-666fd5b0aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.869483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6acde6-d5a3-4e00-aeaf-666fd5b0aaf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.869769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6acde6-d5a3-4e00-aeaf-666fd5b0aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.870074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6acde6-d5a3-4e00-aeaf-666fd5b0aaf4 admin admin] PATH_INFO: `/v3/projects/72dbc2c6687047248c9c2a17abe76e68/users/0ea2f75007964970abab0ff4a7129409/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.885594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6acde6-d5a3-4e00-aeaf-666fd5b0aaf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72dbc2c6687047248c9c2a17abe76e68, user_id=0ea2f75007964970abab0ff4a7129409, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.888371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6acde6-d5a3-4e00-aeaf-666fd5b0aaf4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:05.899528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1011/2024] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:05 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:05.899528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bdb08-213e-4789-8fab-0c7fb43e4c95 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:05.908740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bdb08-213e-4789-8fab-0c7fb43e4c95 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:05.914741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513613-4bc4-4848-a649-c2c07f81d510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:05.919368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513613-4bc4-4848-a649-c2c07f81d510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:05.919368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513613-4bc4-4848-a649-c2c07f81d510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:05.919368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513613-4bc4-4848-a649-c2c07f81d510 admin admin] PATH_INFO: `/v3/projects/adb4f0ee86924ed9b4b17030701c6947/users/02c9cda3368a467d90b442d8348b6d80/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:05.932017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86513613-4bc4-4848-a649-c2c07f81d510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb4f0ee86924ed9b4b17030701c6947, user_id=02c9cda3368a467d90b442d8348b6d80, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:05.935361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86513613-4bc4-4848-a649-c2c07f81d510 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.008168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1014/2025] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:05 2022] PUT /identity/v3/projects/72dbc2c6687047248c9c2a17abe76e68/users/0ea2f75007964970abab0ff4a7129409/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:06.009234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6acde6-d5a3-4e00-aeaf-666fd5b0aaf4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:06.012379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bd6acde6-d5a3-4e00-aeaf-666fd5b0aaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:06.033648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1012/2026] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:05 2022] PUT /identity/v3/projects/adb4f0ee86924ed9b4b17030701c6947/users/02c9cda3368a467d90b442d8348b6d80/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:06.036341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513613-4bc4-4848-a649-c2c07f81d510 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:06.077872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6acde6-d5a3-4e00-aeaf-666fd5b0aaf4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:06.092307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:06.106353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513613-4bc4-4848-a649-c2c07f81d510 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:06.112506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39ac8-6408-4099-9b41-aeed722322c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:06.113194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39ac8-6408-4099-9b41-aeed722322c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.113977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39ac8-6408-4099-9b41-aeed722322c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.113977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b39ac8-6408-4099-9b41-aeed722322c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.116302 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b39ac8-6408-4099-9b41-aeed722322c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:06.118409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b39ac8-6408-4099-9b41-aeed722322c8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.122504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:06.136218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1013/2027] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:06.137675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39ac8-6408-4099-9b41-aeed722322c8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:06.141057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d5ec2-a20e-4f38-835c-fc653a2aecdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:06.141743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d5ec2-a20e-4f38-835c-fc653a2aecdc service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.142013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d5ec2-a20e-4f38-835c-fc653a2aecdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.142346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d5ec2-a20e-4f38-835c-fc653a2aecdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.148128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b39ac8-6408-4099-9b41-aeed722322c8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:06.153704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e3fa5-4879-4569-aec3-baffbb763618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:06.154409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3fa5-4879-4569-aec3-baffbb763618 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.157059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3fa5-4879-4569-aec3-baffbb763618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.157059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e3fa5-4879-4569-aec3-baffbb763618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.157059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e3fa5-4879-4569-aec3-baffbb763618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:06.157969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e3fa5-4879-4569-aec3-baffbb763618 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.172405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1014/2028] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:06.172405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607098-9315-4b5f-84ca-736a32a8cc4c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.172405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607098-9315-4b5f-84ca-736a32a8cc4c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.172405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607098-9315-4b5f-84ca-736a32a8cc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.201614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0a607098-9315-4b5f-84ca-736a32a8cc4c None None] MFA Rules not processed for user `02c9cda3368a467d90b442d8348b6d80`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:06.202934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0a607098-9315-4b5f-84ca-736a32a8cc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:06.225187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d5ec2-a20e-4f38-835c-fc653a2aecdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:06.226665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d5ec2-a20e-4f38-835c-fc653a2aecdc service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.237521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1015/2029] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:06.238320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d5ec2-a20e-4f38-835c-fc653a2aecdc service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:06.249848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d5ec2-a20e-4f38-835c-fc653a2aecdc service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:06.255053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15366682-1677-4b5f-ab21-6ae1ea9ca6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:06.255996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15366682-1677-4b5f-ab21-6ae1ea9ca6df admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.256288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15366682-1677-4b5f-ab21-6ae1ea9ca6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.256570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15366682-1677-4b5f-ab21-6ae1ea9ca6df admin admin] PATH_INFO: `/v3/projects/6fe13bc0899d4e6eb50305c72759272c/users/275e23283b054877b2470daf5ff2e9e8/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.274134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15366682-1677-4b5f-ab21-6ae1ea9ca6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe13bc0899d4e6eb50305c72759272c, user_id=275e23283b054877b2470daf5ff2e9e8, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:06.278487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15366682-1677-4b5f-ab21-6ae1ea9ca6df admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.296387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1015/2030] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:06.296387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607098-9315-4b5f-84ca-736a32a8cc4c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:06.306983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607098-9315-4b5f-84ca-736a32a8cc4c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:06.314003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e194c-7f53-4f2b-8de3-410900fb0e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:06.315074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e194c-7f53-4f2b-8de3-410900fb0e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.315468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e194c-7f53-4f2b-8de3-410900fb0e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.315836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e194c-7f53-4f2b-8de3-410900fb0e9c admin admin] PATH_INFO: `/v3/projects/72dbc2c6687047248c9c2a17abe76e68/users/0ea2f75007964970abab0ff4a7129409/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.318172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e194c-7f53-4f2b-8de3-410900fb0e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=72dbc2c6687047248c9c2a17abe76e68, user_id=0ea2f75007964970abab0ff4a7129409, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:06.321568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e194c-7f53-4f2b-8de3-410900fb0e9c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.334134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1016/2031] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:06 2022] PUT /identity/v3/projects/72dbc2c6687047248c9c2a17abe76e68/users/0ea2f75007964970abab0ff4a7129409/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:06.344791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e194c-7f53-4f2b-8de3-410900fb0e9c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:06.344791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3f8e194c-7f53-4f2b-8de3-410900fb0e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:06.359672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1016/2032] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:06 2022] PUT /identity/v3/projects/6fe13bc0899d4e6eb50305c72759272c/users/275e23283b054877b2470daf5ff2e9e8/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:06.361697 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6490d-db6c-455e-adc7-4a00f2597fa4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.362322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6490d-db6c-455e-adc7-4a00f2597fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.362815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6490d-db6c-455e-adc7-4a00f2597fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.397773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d8b6490d-db6c-455e-adc7-4a00f2597fa4 None None] MFA Rules not processed for user `0ea2f75007964970abab0ff4a7129409`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:06.399281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d8b6490d-db6c-455e-adc7-4a00f2597fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:06.421438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e194c-7f53-4f2b-8de3-410900fb0e9c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:06.483136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87988774-9db1-4259-983b-8f56b1ad7269 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6784d862961b44f48b385bec777ac439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:06.483802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87988774-9db1-4259-983b-8f56b1ad7269 service glance] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.484112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87988774-9db1-4259-983b-8f56b1ad7269 service glance] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.484388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87988774-9db1-4259-983b-8f56b1ad7269 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.500012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1017/2033] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:06.500995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6490d-db6c-455e-adc7-4a00f2597fa4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:06.573277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87988774-9db1-4259-983b-8f56b1ad7269 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:06.575464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87988774-9db1-4259-983b-8f56b1ad7269 service glance] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.587596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6490d-db6c-455e-adc7-4a00f2597fa4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:06.589307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1017/2034] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:06.594217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62527d2-fec4-4df2-b4b1-51da3e0fc3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:06.595389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62527d2-fec4-4df2-b4b1-51da3e0fc3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.607420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62527d2-fec4-4df2-b4b1-51da3e0fc3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.607420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62527d2-fec4-4df2-b4b1-51da3e0fc3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.607420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62527d2-fec4-4df2-b4b1-51da3e0fc3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:06.607420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62527d2-fec4-4df2-b4b1-51da3e0fc3ab admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.613841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1018/2035] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:06.619468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:06.627722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62527d2-fec4-4df2-b4b1-51da3e0fc3ab admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:06.627857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87988774-9db1-4259-983b-8f56b1ad7269 service glance] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:06.629579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c62527d2-fec4-4df2-b4b1-51da3e0fc3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:06.642250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87988774-9db1-4259-983b-8f56b1ad7269 service glance] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:06.647311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c2232-3a74-4ade-b0fc-07a361fc4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:06.648715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c2232-3a74-4ade-b0fc-07a361fc4713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.649071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c2232-3a74-4ade-b0fc-07a361fc4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.649414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c2232-3a74-4ade-b0fc-07a361fc4713 admin admin] PATH_INFO: `/v3/projects/6fe13bc0899d4e6eb50305c72759272c/users/275e23283b054877b2470daf5ff2e9e8/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.652252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c2232-3a74-4ade-b0fc-07a361fc4713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe13bc0899d4e6eb50305c72759272c, user_id=275e23283b054877b2470daf5ff2e9e8, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:06.655542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c2232-3a74-4ade-b0fc-07a361fc4713 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.670576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1018/2036] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:06 2022] PUT /identity/v3/projects/6fe13bc0899d4e6eb50305c72759272c/users/275e23283b054877b2470daf5ff2e9e8/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:06.681586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50745b92-a127-4fbb-86ac-bbe443a4271f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.681950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50745b92-a127-4fbb-86ac-bbe443a4271f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.682594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50745b92-a127-4fbb-86ac-bbe443a4271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.697949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62527d2-fec4-4df2-b4b1-51da3e0fc3ab admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:06.715851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-50745b92-a127-4fbb-86ac-bbe443a4271f None None] MFA Rules not processed for user `275e23283b054877b2470daf5ff2e9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:06.717798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-50745b92-a127-4fbb-86ac-bbe443a4271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:06.756106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f571cf9-34d2-4936-884c-8df6c81fff5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:06.756685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571cf9-34d2-4936-884c-8df6c81fff5a service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:06.756961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571cf9-34d2-4936-884c-8df6c81fff5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:06.757237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571cf9-34d2-4936-884c-8df6c81fff5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:06.759056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4f571cf9-34d2-4936-884c-8df6c81fff5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:06.798969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1019/2037] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:06.813865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:06.818183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f571cf9-34d2-4936-884c-8df6c81fff5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:06.819680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f571cf9-34d2-4936-884c-8df6c81fff5a service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:06.830787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1019/2038] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:07.077677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:07.293908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:07.579685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50745b92-a127-4fbb-86ac-bbe443a4271f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:07.591990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50745b92-a127-4fbb-86ac-bbe443a4271f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:07.595917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50699870-f9f6-4c2a-89d3-1e95f8dfa3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:07.596715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699870-f9f6-4c2a-89d3-1e95f8dfa3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:07.596998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699870-f9f6-4c2a-89d3-1e95f8dfa3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:07.597273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699870-f9f6-4c2a-89d3-1e95f8dfa3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:07.608476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50699870-f9f6-4c2a-89d3-1e95f8dfa3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:07.609953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50699870-f9f6-4c2a-89d3-1e95f8dfa3c5 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:07.633367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1020/2039] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:07.682504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:07.811429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:08.246530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:08.447195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:08.719399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:08.809008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:08.915931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f571cf9-34d2-4936-884c-8df6c81fff5a service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:08.930446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f571cf9-34d2-4936-884c-8df6c81fff5a service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:08.940104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2ac87-981e-43d9-9c68-40d758998bf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:08.941414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2ac87-981e-43d9-9c68-40d758998bf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:08.941760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2ac87-981e-43d9-9c68-40d758998bf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:08.942047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2ac87-981e-43d9-9c68-40d758998bf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:08.945381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7dd2ac87-981e-43d9-9c68-40d758998bf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:09.045182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2ac87-981e-43d9-9c68-40d758998bf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:09.050683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2ac87-981e-43d9-9c68-40d758998bf1 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:09.059919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1020/2040] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:10.186289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50699870-f9f6-4c2a-89d3-1e95f8dfa3c5 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:10.211656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50699870-f9f6-4c2a-89d3-1e95f8dfa3c5 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:10.218817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa527e-60c6-460e-b3f8-a4a0d780ce18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:10.219499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa527e-60c6-460e-b3f8-a4a0d780ce18 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:10.220527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa527e-60c6-460e-b3f8-a4a0d780ce18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:10.220849 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa527e-60c6-460e-b3f8-a4a0d780ce18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:10.298741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa527e-60c6-460e-b3f8-a4a0d780ce18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:10.300645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa527e-60c6-460e-b3f8-a4a0d780ce18 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:10.311804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1021/2041] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:11.912417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2ac87-981e-43d9-9c68-40d758998bf1 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:11.921845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2ac87-981e-43d9-9c68-40d758998bf1 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:11.925696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d50c-55ac-4525-b88a-d08f94095809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:11.926398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d50c-55ac-4525-b88a-d08f94095809 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:11.926714 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d50c-55ac-4525-b88a-d08f94095809 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:11.926997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d50c-55ac-4525-b88a-d08f94095809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:11.979827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:12.003493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779d50c-55ac-4525-b88a-d08f94095809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:12.007647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779d50c-55ac-4525-b88a-d08f94095809 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:12.015230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1021/2042] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:16.180231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa527e-60c6-460e-b3f8-a4a0d780ce18 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:16.190855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa527e-60c6-460e-b3f8-a4a0d780ce18 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:16.195075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9ccf2-2b6b-420c-a838-dd22fee30f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:16.196334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9ccf2-2b6b-420c-a838-dd22fee30f4d service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:16.196334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9ccf2-2b6b-420c-a838-dd22fee30f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:16.196632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9ccf2-2b6b-420c-a838-dd22fee30f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:16.247213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:16.266278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9ccf2-2b6b-420c-a838-dd22fee30f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:16.267814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9ccf2-2b6b-420c-a838-dd22fee30f4d service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:16.277414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1022/2043] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:18.427678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d50c-55ac-4525-b88a-d08f94095809 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:18.509318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d50c-55ac-4525-b88a-d08f94095809 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:18.515507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:18.516594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:18.516946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:18.517378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] PATH_INFO: `/v3/users/cfce6fc26be44ca49e99121220c36746` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:18.519612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfce6fc26be44ca49e99121220c36746)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:18.521934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:18.699270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfce6fc26be44ca49e99121220c36746'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:18.713119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfce6fc26be44ca49e99121220c36746'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:18.714092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfce6fc26be44ca49e99121220c36746'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:18.729597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfce6fc26be44ca49e99121220c36746'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:18.819188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfce6fc26be44ca49e99121220c36746'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:18.828016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1022/2044] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:18 2022] DELETE /identity/v3/users/cfce6fc26be44ca49e99121220c36746 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:18.832766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e044d8-0241-43cd-be02-be22ffcaf37d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:18.833259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e044d8-0241-43cd-be02-be22ffcaf37d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:18.833336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e044d8-0241-43cd-be02-be22ffcaf37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:18.851901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e9e044d8-0241-43cd-be02-be22ffcaf37d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:18.856121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e9e044d8-0241-43cd-be02-be22ffcaf37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:18.924660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1023/2045] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:18.934291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:18.936394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:18.997050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7699820-f430-4d46-af99-5877e72f3769 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:19.001539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c519d-3059-4d98-951f-d01317cf9dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:19.002195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c519d-3059-4d98-951f-d01317cf9dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:19.002477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c519d-3059-4d98-951f-d01317cf9dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:19.004741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c519d-3059-4d98-951f-d01317cf9dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:19.018290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c519d-3059-4d98-951f-d01317cf9dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:19.019812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c519d-3059-4d98-951f-d01317cf9dc9 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:19.023977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:19.030212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1023/2046] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:19.597845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e044d8-0241-43cd-be02-be22ffcaf37d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:19.599573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e9e044d8-0241-43cd-be02-be22ffcaf37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:19.625601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e044d8-0241-43cd-be02-be22ffcaf37d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:19.641376 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:19.642418 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:19.643340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:19.643747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] PATH_INFO: `/v3/projects/467b44c4c4a844e1bc7644549752ff8f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:19.647079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=467b44c4c4a844e1bc7644549752ff8f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:19.649913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:19.816702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467b44c4c4a844e1bc7644549752ff8f', 'request_id': 'req-f397860f-b9dc-477e-8e99-4b312ee56acc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:19.816702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467b44c4c4a844e1bc7644549752ff8f', 'request_id': 'req-f397860f-b9dc-477e-8e99-4b312ee56acc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:19.822606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467b44c4c4a844e1bc7644549752ff8f', 'request_id': 'req-f397860f-b9dc-477e-8e99-4b312ee56acc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:19.906109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] The token cache is being invalidate because project 467b44c4c4a844e1bc7644549752ff8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:19.908789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:19.908789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:19.909641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1024/2047] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:19 2022] DELETE /identity/v3/projects/467b44c4c4a844e1bc7644549752ff8f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:19.913603 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c519d-3059-4d98-951f-d01317cf9dc9 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:19.927199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c519d-3059-4d98-951f-d01317cf9dc9 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:19.992659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:19.993891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:19.994176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:19.994501 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] PATH_INFO: `/v3/users/b70bc71dfe664b2bbe25b90eb8a371e2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:19.996021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70bc71dfe664b2bbe25b90eb8a371e2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:19.997950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:20.323922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70bc71dfe664b2bbe25b90eb8a371e2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:20.330870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70bc71dfe664b2bbe25b90eb8a371e2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:20.331565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70bc71dfe664b2bbe25b90eb8a371e2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:20.350529 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70bc71dfe664b2bbe25b90eb8a371e2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:20.412750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70bc71dfe664b2bbe25b90eb8a371e2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:20.424591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1024/2048] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:19 2022] DELETE /identity/v3/users/b70bc71dfe664b2bbe25b90eb8a371e2 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:20.912803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:20.914272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:20.941444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:20.943348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:20.950969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397860f-b9dc-477e-8e99-4b312ee56acc admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:21.072333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:21.073438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:21.073980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:21.074604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] PATH_INFO: `/v3/users/afec7f67e45a4d3d824498fbc38f36b3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:21.077219 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afec7f67e45a4d3d824498fbc38f36b3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:21.080801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:21.083196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e1746-11e1-4753-aac3-7b6c5d4b4617 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:21.086580 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:21.095731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:21.096762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:21.097076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:21.097801 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] PATH_INFO: `/v3/projects/5974bfa37f9547a6ac8e4ba6f2b43eb3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:21.099124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5974bfa37f9547a6ac8e4ba6f2b43eb3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:21.101790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:21.137064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:21.292772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afec7f67e45a4d3d824498fbc38f36b3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.293018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5974bfa37f9547a6ac8e4ba6f2b43eb3', 'request_id': 'req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.301952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afec7f67e45a4d3d824498fbc38f36b3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.379470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5974bfa37f9547a6ac8e4ba6f2b43eb3', 'request_id': 'req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.387247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5974bfa37f9547a6ac8e4ba6f2b43eb3', 'request_id': 'req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.403385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] The token cache is being invalidate because project 5974bfa37f9547a6ac8e4ba6f2b43eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:21.405386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.406495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.412077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1025/2049] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:20 2022] DELETE /identity/v3/projects/5974bfa37f9547a6ac8e4ba6f2b43eb3 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:21.419563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:21.422958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:21.495900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c8216-7957-46fb-9b32-13e0ee7bbdb6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:21.499507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afec7f67e45a4d3d824498fbc38f36b3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.500367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afec7f67e45a4d3d824498fbc38f36b3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.501618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:21.503067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:21.503595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:21.504067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] PATH_INFO: `/v3/users/0ea2f75007964970abab0ff4a7129409` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:21.505523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea2f75007964970abab0ff4a7129409)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:21.507597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:21.524097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8532f3f9-f4f6-433c-b061-1d1a3a773ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afec7f67e45a4d3d824498fbc38f36b3'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.531066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1025/2050] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:20 2022] DELETE /identity/v3/users/afec7f67e45a4d3d824498fbc38f36b3 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:21.537451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c1b7-f2c8-4b9c-9cf0-2f4b5f8db612 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:21.537775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c1b7-f2c8-4b9c-9cf0-2f4b5f8db612 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:21.538127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c1b7-f2c8-4b9c-9cf0-2f4b5f8db612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:21.556936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3b19c1b7-f2c8-4b9c-9cf0-2f4b5f8db612 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:21.558131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3b19c1b7-f2c8-4b9c-9cf0-2f4b5f8db612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:21.623067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1026/2051] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:21.631617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c1b7-f2c8-4b9c-9cf0-2f4b5f8db612 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:21.632984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3b19c1b7-f2c8-4b9c-9cf0-2f4b5f8db612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:21.690695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c1b7-f2c8-4b9c-9cf0-2f4b5f8db612 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:21.695101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6293e-ada0-445d-8a29-3703cd2d3666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:21.695768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6293e-ada0-445d-8a29-3703cd2d3666 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:21.696089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6293e-ada0-445d-8a29-3703cd2d3666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:21.696431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6293e-ada0-445d-8a29-3703cd2d3666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:21.696602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea2f75007964970abab0ff4a7129409'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.704274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea2f75007964970abab0ff4a7129409'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.705132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea2f75007964970abab0ff4a7129409'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.706918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6293e-ada0-445d-8a29-3703cd2d3666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:21.708479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6293e-ada0-445d-8a29-3703cd2d3666 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:21.718627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea2f75007964970abab0ff4a7129409'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.721210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1027/2052] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:15:21.802516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df8c1f8f-a6be-4aec-86cf-5d26fb2dbf70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea2f75007964970abab0ff4a7129409'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:21.809959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1026/2053] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:21 2022] DELETE /identity/v3/users/0ea2f75007964970abab0ff4a7129409 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:21.821755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfb1ea-4443-4f2a-a1ee-c555628c6fd8 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:21.822060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfb1ea-4443-4f2a-a1ee-c555628c6fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:21.822370 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfb1ea-4443-4f2a-a1ee-c555628c6fd8 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:21.823924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1028/2054] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:15:21.837360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faab508-f727-403f-9c7a-c707834076f4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:21.842702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faab508-f727-403f-9c7a-c707834076f4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:21.842702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faab508-f727-403f-9c7a-c707834076f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:21.857473 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4faab508-f727-403f-9c7a-c707834076f4 None None] MFA Rules not processed for user `c7db581dec064fe0afeb4be5838470bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:21.858995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4faab508-f727-403f-9c7a-c707834076f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:21.963695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1027/2055] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:15:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:21.976768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfb1ea-4443-4f2a-a1ee-c555628c6fd8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:21.980158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3bcfb1ea-4443-4f2a-a1ee-c555628c6fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:22.007522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faab508-f727-403f-9c7a-c707834076f4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:22.007659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfb1ea-4443-4f2a-a1ee-c555628c6fd8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:22.007768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4faab508-f727-403f-9c7a-c707834076f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:22.013565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf995-7f96-44d1-833e-f62ddd9579e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:22.014923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf995-7f96-44d1-833e-f62ddd9579e3 service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:22.015378 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf995-7f96-44d1-833e-f62ddd9579e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:22.015796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf995-7f96-44d1-833e-f62ddd9579e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:22.031684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bf995-7f96-44d1-833e-f62ddd9579e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:22.032666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bf995-7f96-44d1-833e-f62ddd9579e3 service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:22.046565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1029/2056] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:22.106161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faab508-f727-403f-9c7a-c707834076f4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:22.113356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:22.114328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:22.114781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:22.115113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] PATH_INFO: `/v3/users/6cebe6f32ada4875b7777d90ef52b677` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:22.116620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cebe6f32ada4875b7777d90ef52b677)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:22.118814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:22.227943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf995-7f96-44d1-833e-f62ddd9579e3 service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:22.230297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-868bf995-7f96-44d1-833e-f62ddd9579e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:22.255110 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf995-7f96-44d1-833e-f62ddd9579e3 service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:22.266486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:22.267490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:22.267734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:22.268074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] PATH_INFO: `/v3/projects/988d1fb31993424a80d5b7d07aa09bc1` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:22.269643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988d1fb31993424a80d5b7d07aa09bc1)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:22.274703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:22.302668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cebe6f32ada4875b7777d90ef52b677'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.310562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cebe6f32ada4875b7777d90ef52b677'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.311666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cebe6f32ada4875b7777d90ef52b677'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.325106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cebe6f32ada4875b7777d90ef52b677'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.383165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988d1fb31993424a80d5b7d07aa09bc1', 'request_id': 'req-8b40c42d-2477-4bed-850a-15afd3ae30f4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.389853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988d1fb31993424a80d5b7d07aa09bc1', 'request_id': 'req-8b40c42d-2477-4bed-850a-15afd3ae30f4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.395635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988d1fb31993424a80d5b7d07aa09bc1', 'request_id': 'req-8b40c42d-2477-4bed-850a-15afd3ae30f4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.435971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cebe6f32ada4875b7777d90ef52b677'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.445105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1028/2057] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:22 2022] DELETE /identity/v3/users/6cebe6f32ada4875b7777d90ef52b677 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:22.446238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:22.447675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:22.523821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52bd10-61f3-4a0d-a3c8-d1aaf7059fde admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:22.531327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:22.532525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:22.532816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:22.536561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] PATH_INFO: `/v3/projects/72dbc2c6687047248c9c2a17abe76e68` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:22.536695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] The token cache is being invalidate because project 988d1fb31993424a80d5b7d07aa09bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:22.536695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.536695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.536904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1030/2058] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:22 2022] DELETE /identity/v3/projects/988d1fb31993424a80d5b7d07aa09bc1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:22.537271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72dbc2c6687047248c9c2a17abe76e68)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:22.539198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:22.540482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:22.542195 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:22.559568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:22.608020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:22.615038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c42d-2477-4bed-850a-15afd3ae30f4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:22.620080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:22.621010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:22.621293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:22.621570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] PATH_INFO: `/v3/users/33f345a716224a9ca46f05f0679a443a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:22.622830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f345a716224a9ca46f05f0679a443a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:22.625554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:22.656839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72dbc2c6687047248c9c2a17abe76e68', 'request_id': 'req-c24d5509-ddde-4505-815f-c943c65b0f47'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.746015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72dbc2c6687047248c9c2a17abe76e68', 'request_id': 'req-c24d5509-ddde-4505-815f-c943c65b0f47'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.764770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72dbc2c6687047248c9c2a17abe76e68', 'request_id': 'req-c24d5509-ddde-4505-815f-c943c65b0f47'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.775757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] The token cache is being invalidate because project 72dbc2c6687047248c9c2a17abe76e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:22.776082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.776740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.778291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1029/2059] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:22 2022] DELETE /identity/v3/projects/72dbc2c6687047248c9c2a17abe76e68 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:22.779054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:22.782018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:22.821455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f345a716224a9ca46f05f0679a443a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.830656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f345a716224a9ca46f05f0679a443a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.849246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d5509-ddde-4505-815f-c943c65b0f47 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:22.853956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:22.854927 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:22.855207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:22.855509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] PATH_INFO: `/v3/projects/d50e7a75909d4b1fa632974320bdf4db` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:22.856773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50e7a75909d4b1fa632974320bdf4db)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:22.858833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:22.891816 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f345a716224a9ca46f05f0679a443a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.892615 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f345a716224a9ca46f05f0679a443a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.905466 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25572240-a59e-4366-9347-b204ac76a4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f345a716224a9ca46f05f0679a443a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:22.911475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1031/2060] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:22 2022] DELETE /identity/v3/users/33f345a716224a9ca46f05f0679a443a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:22.912716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dca7b-ba20-47f9-a2b2-0ab0f10eee8d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:22.913001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dca7b-ba20-47f9-a2b2-0ab0f10eee8d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:22.913278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dca7b-ba20-47f9-a2b2-0ab0f10eee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:22.933430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c75dca7b-ba20-47f9-a2b2-0ab0f10eee8d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:22.934652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c75dca7b-ba20-47f9-a2b2-0ab0f10eee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:22.979559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50e7a75909d4b1fa632974320bdf4db', 'request_id': 'req-972be01d-848e-424a-82fb-edcd4e88f413'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.012673 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1032/2061] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:23.020338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd80e0-2212-4270-b639-0c7b2ccb9649 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.020626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd80e0-2212-4270-b639-0c7b2ccb9649 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.020906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd80e0-2212-4270-b639-0c7b2ccb9649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.041746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50e7a75909d4b1fa632974320bdf4db', 'request_id': 'req-972be01d-848e-424a-82fb-edcd4e88f413'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.048688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a5fd80e0-2212-4270-b639-0c7b2ccb9649 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:23.050210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a5fd80e0-2212-4270-b639-0c7b2ccb9649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:23.050896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50e7a75909d4b1fa632974320bdf4db', 'request_id': 'req-972be01d-848e-424a-82fb-edcd4e88f413'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.064088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] The token cache is being invalidate because project d50e7a75909d4b1fa632974320bdf4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:23.064570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.065466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-972be01d-848e-424a-82fb-edcd4e88f413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.067141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1030/2062] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:22 2022] DELETE /identity/v3/projects/d50e7a75909d4b1fa632974320bdf4db => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:23.072154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d346c6-69c4-45db-b26b-bcd199fe3301 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.073640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d346c6-69c4-45db-b26b-bcd199fe3301 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.073934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d346c6-69c4-45db-b26b-bcd199fe3301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.095160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-06d346c6-69c4-45db-b26b-bcd199fe3301 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:23.096498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-06d346c6-69c4-45db-b26b-bcd199fe3301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:23.117258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1033/2063] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:23.122455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd80e0-2212-4270-b639-0c7b2ccb9649 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.134744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd80e0-2212-4270-b639-0c7b2ccb9649 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.140761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d620f8-6511-4511-ba13-8807b6faebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.141939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d620f8-6511-4511-ba13-8807b6faebdd admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.142461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d620f8-6511-4511-ba13-8807b6faebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.142925 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d620f8-6511-4511-ba13-8807b6faebdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.144021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d620f8-6511-4511-ba13-8807b6faebdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:23.144565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d620f8-6511-4511-ba13-8807b6faebdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.146340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d620f8-6511-4511-ba13-8807b6faebdd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.164231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1034/2064] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:23.165528 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d620f8-6511-4511-ba13-8807b6faebdd admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.176088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1031/2065] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:23.179723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d620f8-6511-4511-ba13-8807b6faebdd admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.188576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66272f4b-99e2-4698-ac9a-7377ebc64b0f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.188866 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66272f4b-99e2-4698-ac9a-7377ebc64b0f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.199953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66272f4b-99e2-4698-ac9a-7377ebc64b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.200204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae0110-e073-4c38-9007-aef98bbe21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.200204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae0110-e073-4c38-9007-aef98bbe21f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.200204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae0110-e073-4c38-9007-aef98bbe21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.200204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae0110-e073-4c38-9007-aef98bbe21f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.200628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae0110-e073-4c38-9007-aef98bbe21f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.200628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae0110-e073-4c38-9007-aef98bbe21f9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.208106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-66272f4b-99e2-4698-ac9a-7377ebc64b0f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:23.209311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-66272f4b-99e2-4698-ac9a-7377ebc64b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:23.217852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1032/2066] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:23.222505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66272f4b-99e2-4698-ac9a-7377ebc64b0f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.232273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66272f4b-99e2-4698-ac9a-7377ebc64b0f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.238192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f0c2-10c7-4ae0-bf9e-99ded74beccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.238914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f0c2-10c7-4ae0-bf9e-99ded74beccf admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.239201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f0c2-10c7-4ae0-bf9e-99ded74beccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.239478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f0c2-10c7-4ae0-bf9e-99ded74beccf admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.240261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f0c2-10c7-4ae0-bf9e-99ded74beccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:23.240575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f0c2-10c7-4ae0-bf9e-99ded74beccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.242180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f0c2-10c7-4ae0-bf9e-99ded74beccf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.254857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1033/2067] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:15:23.259170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f0c2-10c7-4ae0-bf9e-99ded74beccf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.271832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f0c2-10c7-4ae0-bf9e-99ded74beccf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.278342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973bd48-35fa-4d50-803f-b3f2d30b4ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.279011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973bd48-35fa-4d50-803f-b3f2d30b4ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.279297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973bd48-35fa-4d50-803f-b3f2d30b4ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.280291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973bd48-35fa-4d50-803f-b3f2d30b4ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.281018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973bd48-35fa-4d50-803f-b3f2d30b4ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.282939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973bd48-35fa-4d50-803f-b3f2d30b4ce1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.313096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1035/2068] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:23 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:23.317548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae0110-e073-4c38-9007-aef98bbe21f9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.334209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:23.393271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae0110-e073-4c38-9007-aef98bbe21f9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.398301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd623-e37b-4263-bd20-04d374d051fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.398982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd623-e37b-4263-bd20-04d374d051fa admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.399332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd623-e37b-4263-bd20-04d374d051fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.399611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd623-e37b-4263-bd20-04d374d051fa admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.400400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cd623-e37b-4263-bd20-04d374d051fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.402311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cd623-e37b-4263-bd20-04d374d051fa admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.402910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1034/2069] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:23 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:23.407827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973bd48-35fa-4d50-803f-b3f2d30b4ce1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.433299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:23.489155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1036/2070] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:23 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:23.490260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd623-e37b-4263-bd20-04d374d051fa admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.492066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-af9cd623-e37b-4263-bd20-04d374d051fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:23.507605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973bd48-35fa-4d50-803f-b3f2d30b4ce1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.508090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd623-e37b-4263-bd20-04d374d051fa admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.512625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.513730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520ab19-edcd-4395-a9bd-aa35ecc41733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.513905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.514506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520ab19-edcd-4395-a9bd-aa35ecc41733 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.514727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.514833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520ab19-edcd-4395-a9bd-aa35ecc41733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.515020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] PATH_INFO: `/v3/projects/90e4dac597d54ac99ae08751f2b5e982` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.515113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520ab19-edcd-4395-a9bd-aa35ecc41733 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.515916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520ab19-edcd-4395-a9bd-aa35ecc41733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.516315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e4dac597d54ac99ae08751f2b5e982)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.518375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.518547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520ab19-edcd-4395-a9bd-aa35ecc41733 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.635825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1035/2071] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:23 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:23.636768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520ab19-edcd-4395-a9bd-aa35ecc41733 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.647511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520ab19-edcd-4395-a9bd-aa35ecc41733 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.652305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5d1f2-0917-4ab5-bf1a-67c54a6b7d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.652985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5d1f2-0917-4ab5-bf1a-67c54a6b7d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.653268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5d1f2-0917-4ab5-bf1a-67c54a6b7d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.653546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5d1f2-0917-4ab5-bf1a-67c54a6b7d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.654275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5d1f2-0917-4ab5-bf1a-67c54a6b7d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.657091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5d1f2-0917-4ab5-bf1a-67c54a6b7d21 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.673469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1036/2072] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:23.674612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5d1f2-0917-4ab5-bf1a-67c54a6b7d21 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.682686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e4dac597d54ac99ae08751f2b5e982', 'request_id': 'req-adf03a29-ac4c-427c-85e6-162233b9b126'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.685555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5d1f2-0917-4ab5-bf1a-67c54a6b7d21 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.689880 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e4dac597d54ac99ae08751f2b5e982', 'request_id': 'req-adf03a29-ac4c-427c-85e6-162233b9b126'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.695792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e4dac597d54ac99ae08751f2b5e982', 'request_id': 'req-adf03a29-ac4c-427c-85e6-162233b9b126'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.753680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5f61-d423-4d69-8d31-be038d34d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.754350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5f61-d423-4d69-8d31-be038d34d274 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.754635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5f61-d423-4d69-8d31-be038d34d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.754913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5f61-d423-4d69-8d31-be038d34d274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.755652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c5f61-d423-4d69-8d31-be038d34d274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.757289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c5f61-d423-4d69-8d31-be038d34d274 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.768871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1037/2073] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:23.769838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5f61-d423-4d69-8d31-be038d34d274 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.780119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5f61-d423-4d69-8d31-be038d34d274 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.784788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a43a0-62ff-486d-8b5a-579ff495fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.785430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a43a0-62ff-486d-8b5a-579ff495fa8d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.785716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a43a0-62ff-486d-8b5a-579ff495fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.785994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a43a0-62ff-486d-8b5a-579ff495fa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.786720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a43a0-62ff-486d-8b5a-579ff495fa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.788351 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a43a0-62ff-486d-8b5a-579ff495fa8d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.798255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1038/2074] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:23.799096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a43a0-62ff-486d-8b5a-579ff495fa8d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.809222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] The token cache is being invalidate because project 90e4dac597d54ac99ae08751f2b5e982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:23.809222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.813303 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:23.816307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1037/2075] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:23 2022] DELETE /identity/v3/projects/90e4dac597d54ac99ae08751f2b5e982 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:23.816811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.819673 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:23.823374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a43a0-62ff-486d-8b5a-579ff495fa8d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.829135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070eca-9c51-4ab0-af71-ef16b157708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.829798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070eca-9c51-4ab0-af71-ef16b157708f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.830083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070eca-9c51-4ab0-af71-ef16b157708f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.830358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070eca-9c51-4ab0-af71-ef16b157708f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.831113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a070eca-9c51-4ab0-af71-ef16b157708f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.832734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a070eca-9c51-4ab0-af71-ef16b157708f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.833395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf03a29-ac4c-427c-85e6-162233b9b126 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.838256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53214935-21a3-4db6-972e-0ecfd81b8ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.842682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53214935-21a3-4db6-972e-0ecfd81b8ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.842682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53214935-21a3-4db6-972e-0ecfd81b8ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.842682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53214935-21a3-4db6-972e-0ecfd81b8ede admin admin] PATH_INFO: `/v3/projects/696668cc0fd44309b8c63039134d31e0/users/af5013cc1e6b4c6083ffe17f25be98ba/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.846112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1039/2076] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:23.846977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070eca-9c51-4ab0-af71-ef16b157708f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.850402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a070eca-9c51-4ab0-af71-ef16b157708f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:23.861990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53214935-21a3-4db6-972e-0ecfd81b8ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=696668cc0fd44309b8c63039134d31e0, user_id=af5013cc1e6b4c6083ffe17f25be98ba, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.865004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070eca-9c51-4ab0-af71-ef16b157708f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:23.865133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53214935-21a3-4db6-972e-0ecfd81b8ede admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.869404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:23.870362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:23.870710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:23.870992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] PATH_INFO: `/v3/users/275e23283b054877b2470daf5ff2e9e8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:23.872291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275e23283b054877b2470daf5ff2e9e8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:23.874236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:23.973307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1038/2077] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:23 2022] PUT /identity/v3/projects/696668cc0fd44309b8c63039134d31e0/users/af5013cc1e6b4c6083ffe17f25be98ba/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:23.974168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53214935-21a3-4db6-972e-0ecfd81b8ede admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:23.975704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-53214935-21a3-4db6-972e-0ecfd81b8ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:24.046737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53214935-21a3-4db6-972e-0ecfd81b8ede admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:24.051555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be85156-5392-4e75-b6d6-bc1373424389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:24.052482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be85156-5392-4e75-b6d6-bc1373424389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:24.052771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be85156-5392-4e75-b6d6-bc1373424389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:24.053052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be85156-5392-4e75-b6d6-bc1373424389 admin admin] PATH_INFO: `/v3/projects/80e8b62191f343cd952001c53eb33dd8/users/f853f73c6c974a119376f4359c00f144/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:24.068439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be85156-5392-4e75-b6d6-bc1373424389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e8b62191f343cd952001c53eb33dd8, user_id=f853f73c6c974a119376f4359c00f144, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:24.071267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be85156-5392-4e75-b6d6-bc1373424389 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:24.105175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275e23283b054877b2470daf5ff2e9e8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:24.111982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275e23283b054877b2470daf5ff2e9e8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:24.112640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275e23283b054877b2470daf5ff2e9e8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:24.124792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275e23283b054877b2470daf5ff2e9e8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:24.213100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1039/2078] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:23 2022] PUT /identity/v3/projects/80e8b62191f343cd952001c53eb33dd8/users/f853f73c6c974a119376f4359c00f144/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:24.214382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e02647-2161-46cf-9ec0-a805683f80c1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:24.214670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e02647-2161-46cf-9ec0-a805683f80c1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:24.214948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e02647-2161-46cf-9ec0-a805683f80c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:24.235690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0290c19b-a458-49c7-a80c-518fec2cadc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275e23283b054877b2470daf5ff2e9e8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:24.240954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f6e02647-2161-46cf-9ec0-a805683f80c1 None None] MFA Rules not processed for user `af5013cc1e6b4c6083ffe17f25be98ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:24.241914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1040/2079] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:23 2022] DELETE /identity/v3/users/275e23283b054877b2470daf5ff2e9e8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:24.242220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f6e02647-2161-46cf-9ec0-a805683f80c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:24.243287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d812-d6a2-4e36-bb91-5a5a64a9b1a1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:24.243701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d812-d6a2-4e36-bb91-5a5a64a9b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:24.247614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d812-d6a2-4e36-bb91-5a5a64a9b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:24.263596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:24.273142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3244d812-d6a2-4e36-bb91-5a5a64a9b1a1 None None] MFA Rules not processed for user `f853f73c6c974a119376f4359c00f144`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:24.274742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3244d812-d6a2-4e36-bb91-5a5a64a9b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:24.306151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:24.323776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1040/2080] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:24.336636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e02647-2161-46cf-9ec0-a805683f80c1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:24.338556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f6e02647-2161-46cf-9ec0-a805683f80c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:24.348068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1041/2081] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:24.352110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d812-d6a2-4e36-bb91-5a5a64a9b1a1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:24.353615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3244d812-d6a2-4e36-bb91-5a5a64a9b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:24.396493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e02647-2161-46cf-9ec0-a805683f80c1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:24.400252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2146d-9ce2-46d3-9bfc-cf4e1fdfe3f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6784d862961b44f48b385bec777ac439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:24.400900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2146d-9ce2-46d3-9bfc-cf4e1fdfe3f8 service glance] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:24.401185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2146d-9ce2-46d3-9bfc-cf4e1fdfe3f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:24.401463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2146d-9ce2-46d3-9bfc-cf4e1fdfe3f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:24.410524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2146d-9ce2-46d3-9bfc-cf4e1fdfe3f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:24.411747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2146d-9ce2-46d3-9bfc-cf4e1fdfe3f8 service glance] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:24.422027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1041/2082] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:24.427633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d812-d6a2-4e36-bb91-5a5a64a9b1a1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:24.432415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239684d4-6a5c-4bd2-9c31-fb542c034d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:24.433270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239684d4-6a5c-4bd2-9c31-fb542c034d6d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:24.433621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239684d4-6a5c-4bd2-9c31-fb542c034d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:24.433962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239684d4-6a5c-4bd2-9c31-fb542c034d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:24.434726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239684d4-6a5c-4bd2-9c31-fb542c034d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:24.437539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239684d4-6a5c-4bd2-9c31-fb542c034d6d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:24.516358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:24.524806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1042/2083] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:24 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:24.528667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2146d-9ce2-46d3-9bfc-cf4e1fdfe3f8 service glance] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:24.539983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2146d-9ce2-46d3-9bfc-cf4e1fdfe3f8 service glance] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:24.605166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0eb7-362f-4c18-ac65-10e5b0610b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:24.606131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0eb7-362f-4c18-ac65-10e5b0610b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:24.606495 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0eb7-362f-4c18-ac65-10e5b0610b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:24.606756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0eb7-362f-4c18-ac65-10e5b0610b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:24.608060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e0eb7-362f-4c18-ac65-10e5b0610b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:24.610338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e0eb7-362f-4c18-ac65-10e5b0610b20 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:24.699040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1042/2084] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:24 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:24.703982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239684d4-6a5c-4bd2-9c31-fb542c034d6d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:24.715826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239684d4-6a5c-4bd2-9c31-fb542c034d6d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:24.721407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720e29-3988-4a44-8bd6-db7517893699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:24.722083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720e29-3988-4a44-8bd6-db7517893699 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:24.722367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720e29-3988-4a44-8bd6-db7517893699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:24.722646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720e29-3988-4a44-8bd6-db7517893699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:24.723389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720e29-3988-4a44-8bd6-db7517893699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:24.725191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720e29-3988-4a44-8bd6-db7517893699 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:24.746876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1043/2085] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:24.746980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0eb7-362f-4c18-ac65-10e5b0610b20 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:24.747070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720e29-3988-4a44-8bd6-db7517893699 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:24.747153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e99e0eb7-362f-4c18-ac65-10e5b0610b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:24.756562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720e29-3988-4a44-8bd6-db7517893699 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:24.768129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0eb7-362f-4c18-ac65-10e5b0610b20 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:24.775240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:24.776313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:24.776656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:24.776994 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] PATH_INFO: `/v3/projects/6fe13bc0899d4e6eb50305c72759272c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:24.778564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe13bc0899d4e6eb50305c72759272c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:24.778945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c21c2-077f-4cb6-a8a8-54c2c18d5aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:24.780761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:24.781953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c21c2-077f-4cb6-a8a8-54c2c18d5aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:24.782368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c21c2-077f-4cb6-a8a8-54c2c18d5aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:24.782644 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c21c2-077f-4cb6-a8a8-54c2c18d5aa7 admin admin] PATH_INFO: `/v3/projects/2661bd9bba7c41759593a4480132fa73/users/01c2be33cce9491d91f75188df2f248e/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:24.806566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:24.820393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c21c2-077f-4cb6-a8a8-54c2c18d5aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2661bd9bba7c41759593a4480132fa73, user_id=01c2be33cce9491d91f75188df2f248e, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:24.820393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c21c2-077f-4cb6-a8a8-54c2c18d5aa7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:24.898324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1044/2086] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:24 2022] PUT /identity/v3/projects/2661bd9bba7c41759593a4480132fa73/users/01c2be33cce9491d91f75188df2f248e/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:24.902320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c21c2-077f-4cb6-a8a8-54c2c18d5aa7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:24.914183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe13bc0899d4e6eb50305c72759272c', 'request_id': 'req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:24.922346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe13bc0899d4e6eb50305c72759272c', 'request_id': 'req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:24.928260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe13bc0899d4e6eb50305c72759272c', 'request_id': 'req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:24.964850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c21c2-077f-4cb6-a8a8-54c2c18d5aa7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.019694 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf9a29-5195-4c14-a95a-9dd58a09d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.020321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf9a29-5195-4c14-a95a-9dd58a09d7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.020609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf9a29-5195-4c14-a95a-9dd58a09d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.020882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf9a29-5195-4c14-a95a-9dd58a09d7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.021723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf9a29-5195-4c14-a95a-9dd58a09d7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.023379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf9a29-5195-4c14-a95a-9dd58a09d7b2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.035249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1045/2087] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:25.046682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf9a29-5195-4c14-a95a-9dd58a09d7b2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.057593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf9a29-5195-4c14-a95a-9dd58a09d7b2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.063257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f0d2c-d967-48fc-bd57-3bb86d4b0149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.068609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0d2c-d967-48fc-bd57-3bb86d4b0149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.068609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0d2c-d967-48fc-bd57-3bb86d4b0149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.068609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0d2c-d967-48fc-bd57-3bb86d4b0149 admin admin] PATH_INFO: `/v3/projects/2661bd9bba7c41759593a4480132fa73/users/01c2be33cce9491d91f75188df2f248e/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.068609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f0d2c-d967-48fc-bd57-3bb86d4b0149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2661bd9bba7c41759593a4480132fa73, user_id=01c2be33cce9491d91f75188df2f248e, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.069843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f0d2c-d967-48fc-bd57-3bb86d4b0149 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.070752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] The token cache is being invalidate because project 6fe13bc0899d4e6eb50305c72759272c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:25.071224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:25.071810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc9e8ba3-e9dd-4892-ab7f-a436f01d9217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:25.073776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1043/2088] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:24 2022] DELETE /identity/v3/projects/6fe13bc0899d4e6eb50305c72759272c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:25.079736 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb814-41bd-4ecf-a4ac-80cd93045b66 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.080138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb814-41bd-4ecf-a4ac-80cd93045b66 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.080379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb814-41bd-4ecf-a4ac-80cd93045b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.082465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1046/2089] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:25 2022] PUT /identity/v3/projects/2661bd9bba7c41759593a4480132fa73/users/01c2be33cce9491d91f75188df2f248e/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:25.093962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150e7a9-0bc9-46a7-b56e-59f8d7889222 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.094264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150e7a9-0bc9-46a7-b56e-59f8d7889222 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.094554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150e7a9-0bc9-46a7-b56e-59f8d7889222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.103978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-da3fb814-41bd-4ecf-a4ac-80cd93045b66 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:25.105283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-da3fb814-41bd-4ecf-a4ac-80cd93045b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:25.126239 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1150e7a9-0bc9-46a7-b56e-59f8d7889222 None None] MFA Rules not processed for user `01c2be33cce9491d91f75188df2f248e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:25.127447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1150e7a9-0bc9-46a7-b56e-59f8d7889222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:25.166273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1044/2090] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:25.175278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0edd2-25bf-4f53-8510-6fa830e3db03 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.175575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0edd2-25bf-4f53-8510-6fa830e3db03 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.175861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0edd2-25bf-4f53-8510-6fa830e3db03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.204034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c2c0edd2-25bf-4f53-8510-6fa830e3db03 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:25.205273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c2c0edd2-25bf-4f53-8510-6fa830e3db03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:25.205555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1047/2091] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:25.216949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150e7a9-0bc9-46a7-b56e-59f8d7889222 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.218238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1045/2092] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:25.219652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1150e7a9-0bc9-46a7-b56e-59f8d7889222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:25.222279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0edd2-25bf-4f53-8510-6fa830e3db03 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.231297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0edd2-25bf-4f53-8510-6fa830e3db03 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.236602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5571154-e375-4906-93d6-8fa2081e40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.237252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5571154-e375-4906-93d6-8fa2081e40ff admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.237533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5571154-e375-4906-93d6-8fa2081e40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.237801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5571154-e375-4906-93d6-8fa2081e40ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.238522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5571154-e375-4906-93d6-8fa2081e40ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:25.238826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5571154-e375-4906-93d6-8fa2081e40ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.240501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5571154-e375-4906-93d6-8fa2081e40ff admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.252455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1046/2093] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:15:25.256653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5571154-e375-4906-93d6-8fa2081e40ff admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.266421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5571154-e375-4906-93d6-8fa2081e40ff admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.271106 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d1b5-272d-4766-8c19-d664674fe993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.271700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d1b5-272d-4766-8c19-d664674fe993 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.272045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d1b5-272d-4766-8c19-d664674fe993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.272331 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1d1b5-272d-4766-8c19-d664674fe993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.273006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1d1b5-272d-4766-8c19-d664674fe993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.275034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1d1b5-272d-4766-8c19-d664674fe993 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.280597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150e7a9-0bc9-46a7-b56e-59f8d7889222 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.284241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcc197-f135-4c1a-91da-dd5e4252681b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.284884 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc197-f135-4c1a-91da-dd5e4252681b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.285165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc197-f135-4c1a-91da-dd5e4252681b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.285575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc197-f135-4c1a-91da-dd5e4252681b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.296305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcc197-f135-4c1a-91da-dd5e4252681b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.297743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcc197-f135-4c1a-91da-dd5e4252681b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.307371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1048/2094] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:25.321720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:25.391519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1047/2095] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:25 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:25.395797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcc197-f135-4c1a-91da-dd5e4252681b service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.406755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcc197-f135-4c1a-91da-dd5e4252681b service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.438434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d1b5-272d-4766-8c19-d664674fe993 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.440521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2ef1d1b5-272d-4766-8c19-d664674fe993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:25.473986 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43e2f9-af8a-43a6-a25e-24736afc46eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.474852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43e2f9-af8a-43a6-a25e-24736afc46eb admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.475200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43e2f9-af8a-43a6-a25e-24736afc46eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.483671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43e2f9-af8a-43a6-a25e-24736afc46eb admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.483671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43e2f9-af8a-43a6-a25e-24736afc46eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.483671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43e2f9-af8a-43a6-a25e-24736afc46eb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.513439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1d1b5-272d-4766-8c19-d664674fe993 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.517830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b16794-4b87-4906-821f-99b21b5d1d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.518482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b16794-4b87-4906-821f-99b21b5d1d60 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.518983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b16794-4b87-4906-821f-99b21b5d1d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.521534 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:25.523986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b16794-4b87-4906-821f-99b21b5d1d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.526560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d9b16794-4b87-4906-821f-99b21b5d1d60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:25.568657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1049/2096] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:25 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:25.572835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43e2f9-af8a-43a6-a25e-24736afc46eb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.582700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43e2f9-af8a-43a6-a25e-24736afc46eb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.587745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920d1a-e706-45e5-8d07-676467dd2432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.588496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920d1a-e706-45e5-8d07-676467dd2432 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.588765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920d1a-e706-45e5-8d07-676467dd2432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.589041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920d1a-e706-45e5-8d07-676467dd2432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.589371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b16794-4b87-4906-821f-99b21b5d1d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.589763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d920d1a-e706-45e5-8d07-676467dd2432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.590838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b16794-4b87-4906-821f-99b21b5d1d60 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.591347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d920d1a-e706-45e5-8d07-676467dd2432 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.601096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1048/2097] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:15:25.602051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1050/2098] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:25.605905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b16794-4b87-4906-821f-99b21b5d1d60 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.617404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b16794-4b87-4906-821f-99b21b5d1d60 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.622143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21f6ee-8e48-4d62-a43e-856b6a1e77a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.624769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21f6ee-8e48-4d62-a43e-856b6a1e77a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.624769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21f6ee-8e48-4d62-a43e-856b6a1e77a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.624769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21f6ee-8e48-4d62-a43e-856b6a1e77a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.625502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21f6ee-8e48-4d62-a43e-856b6a1e77a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.627607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21f6ee-8e48-4d62-a43e-856b6a1e77a4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.638289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1049/2099] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:25.642749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920d1a-e706-45e5-8d07-676467dd2432 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.652701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920d1a-e706-45e5-8d07-676467dd2432 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:25.658101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247cefe-51f0-41f0-ad4e-031bf2804cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:25.672100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247cefe-51f0-41f0-ad4e-031bf2804cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.672100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247cefe-51f0-41f0-ad4e-031bf2804cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.672100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247cefe-51f0-41f0-ad4e-031bf2804cfe admin admin] PATH_INFO: `/v3/projects/4c08962bf6ce45b6b0876859e8bb03d9/users/7cf79b1dccfa4063b42194bfc3c3a9cb/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.675563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247cefe-51f0-41f0-ad4e-031bf2804cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c08962bf6ce45b6b0876859e8bb03d9, user_id=7cf79b1dccfa4063b42194bfc3c3a9cb, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:25.678263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247cefe-51f0-41f0-ad4e-031bf2804cfe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:25.790668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1051/2100] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:25 2022] PUT /identity/v3/projects/4c08962bf6ce45b6b0876859e8bb03d9/users/7cf79b1dccfa4063b42194bfc3c3a9cb/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:25.796521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a126d83-4e61-48c4-820c-5d6d662ad2d7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:25.797360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a126d83-4e61-48c4-820c-5d6d662ad2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:25.797650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a126d83-4e61-48c4-820c-5d6d662ad2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:25.816395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0a126d83-4e61-48c4-820c-5d6d662ad2d7 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:25.818136 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0a126d83-4e61-48c4-820c-5d6d662ad2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:25.895993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1050/2101] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:25.906232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247cefe-51f0-41f0-ad4e-031bf2804cfe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:25.908137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1247cefe-51f0-41f0-ad4e-031bf2804cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:25.998621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247cefe-51f0-41f0-ad4e-031bf2804cfe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:26.002428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf64c6-e9b1-496d-b9b9-d73d11b85271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:26.003070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf64c6-e9b1-496d-b9b9-d73d11b85271 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:26.003353 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf64c6-e9b1-496d-b9b9-d73d11b85271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:26.003629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf64c6-e9b1-496d-b9b9-d73d11b85271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:26.013151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf64c6-e9b1-496d-b9b9-d73d11b85271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:26.015090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf64c6-e9b1-496d-b9b9-d73d11b85271 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:26.025330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1052/2102] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:26.186459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:26.709035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:27.655251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6fcf9-aced-41fa-b463-a2492d70528b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:27.655784 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6fcf9-aced-41fa-b463-a2492d70528b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:27.655784 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6fcf9-aced-41fa-b463-a2492d70528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:27.680404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:27.691286 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-40d6fcf9-aced-41fa-b463-a2492d70528b None None] MFA Rules not processed for user `7cf79b1dccfa4063b42194bfc3c3a9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:27.692541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-40d6fcf9-aced-41fa-b463-a2492d70528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:27.799570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf64c6-e9b1-496d-b9b9-d73d11b85271 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:27.805035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1051/2103] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:27.810209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf64c6-e9b1-496d-b9b9-d73d11b85271 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:27.815760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dd7ba-3d68-443b-b967-95faaf86f9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:27.816642 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dd7ba-3d68-443b-b967-95faaf86f9da admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:27.817075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dd7ba-3d68-443b-b967-95faaf86f9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:27.817354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dd7ba-3d68-443b-b967-95faaf86f9da admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:27.818056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dd7ba-3d68-443b-b967-95faaf86f9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:27.820174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dd7ba-3d68-443b-b967-95faaf86f9da admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:27.932919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1053/2104] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:27 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:27.937479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6fcf9-aced-41fa-b463-a2492d70528b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:27.948047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6fcf9-aced-41fa-b463-a2492d70528b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:28.007452 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832afac6-507e-4b71-918e-4bd7d6a7f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:28.008152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832afac6-507e-4b71-918e-4bd7d6a7f81c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:28.008434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832afac6-507e-4b71-918e-4bd7d6a7f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:28.008706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832afac6-507e-4b71-918e-4bd7d6a7f81c admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:28.009397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832afac6-507e-4b71-918e-4bd7d6a7f81c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:28.011347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832afac6-507e-4b71-918e-4bd7d6a7f81c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:28.139346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1052/2105] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:27 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:28.143207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dd7ba-3d68-443b-b967-95faaf86f9da admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:28.153466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dd7ba-3d68-443b-b967-95faaf86f9da admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:28.158850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02730a9e-3242-4380-8f95-6399c759c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:28.159511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02730a9e-3242-4380-8f95-6399c759c635 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:28.159793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02730a9e-3242-4380-8f95-6399c759c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:28.160097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02730a9e-3242-4380-8f95-6399c759c635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:28.160828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02730a9e-3242-4380-8f95-6399c759c635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:28.162426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02730a9e-3242-4380-8f95-6399c759c635 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:28.173939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1054/2106] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:28.179265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832afac6-507e-4b71-918e-4bd7d6a7f81c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:28.190158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832afac6-507e-4b71-918e-4bd7d6a7f81c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:28.194974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e9f6-9095-4d30-bbc8-47ce06670c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:28.195865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e9f6-9095-4d30-bbc8-47ce06670c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:28.196172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e9f6-9095-4d30-bbc8-47ce06670c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:28.196456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e9f6-9095-4d30-bbc8-47ce06670c20 admin admin] PATH_INFO: `/v3/projects/6165e92561c24d42884498a045878552/users/9a924baffec2476fb9f12341b8310ac5/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:28.212648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07e9f6-9095-4d30-bbc8-47ce06670c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6165e92561c24d42884498a045878552, user_id=9a924baffec2476fb9f12341b8310ac5, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:28.215312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07e9f6-9095-4d30-bbc8-47ce06670c20 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:28.218200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:28.305943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1053/2107] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:28 2022] PUT /identity/v3/projects/6165e92561c24d42884498a045878552/users/9a924baffec2476fb9f12341b8310ac5/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:28.309808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02730a9e-3242-4380-8f95-6399c759c635 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:28.321025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02730a9e-3242-4380-8f95-6399c759c635 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:28.392685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbfb24-e903-4b59-8d4e-79e7bcf78069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:28.393340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbfb24-e903-4b59-8d4e-79e7bcf78069 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:28.393631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbfb24-e903-4b59-8d4e-79e7bcf78069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:28.393914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbfb24-e903-4b59-8d4e-79e7bcf78069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:28.394681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbfb24-e903-4b59-8d4e-79e7bcf78069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:28.396324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbfb24-e903-4b59-8d4e-79e7bcf78069 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:28.407984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1055/2108] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:28.411905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e9f6-9095-4d30-bbc8-47ce06670c20 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:28.423823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e9f6-9095-4d30-bbc8-47ce06670c20 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:28.429000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34307ab-1548-48c9-b297-ef43503a4add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:28.429896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34307ab-1548-48c9-b297-ef43503a4add admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:28.430183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34307ab-1548-48c9-b297-ef43503a4add admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:28.430460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34307ab-1548-48c9-b297-ef43503a4add admin admin] PATH_INFO: `/v3/projects/6165e92561c24d42884498a045878552/users/9a924baffec2476fb9f12341b8310ac5/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:28.432476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34307ab-1548-48c9-b297-ef43503a4add admin admin] RBAC: Authorizing `identity:create_grant(project_id=6165e92561c24d42884498a045878552, user_id=9a924baffec2476fb9f12341b8310ac5, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:28.435214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34307ab-1548-48c9-b297-ef43503a4add admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:28.455641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1054/2109] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:28 2022] PUT /identity/v3/projects/6165e92561c24d42884498a045878552/users/9a924baffec2476fb9f12341b8310ac5/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:29.781250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbb6af-1a53-48d1-b5fb-768c25d8be85 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:29.787546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbb6af-1a53-48d1-b5fb-768c25d8be85 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:29.787546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbb6af-1a53-48d1-b5fb-768c25d8be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:29.824472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-68fbb6af-1a53-48d1-b5fb-768c25d8be85 None None] MFA Rules not processed for user `9a924baffec2476fb9f12341b8310ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:29.825798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-68fbb6af-1a53-48d1-b5fb-768c25d8be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:29.863755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:29.898979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1056/2110] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:29.911828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37663d-8cbf-4d48-bbc7-c227227abbe2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:29.912365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37663d-8cbf-4d48-bbc7-c227227abbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:29.912455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37663d-8cbf-4d48-bbc7-c227227abbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:29.930888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9c37663d-8cbf-4d48-bbc7-c227227abbe2 None None] MFA Rules not processed for user `7cf79b1dccfa4063b42194bfc3c3a9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:29.932226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9c37663d-8cbf-4d48-bbc7-c227227abbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:29.989315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1055/2111] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:30.000629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbb6af-1a53-48d1-b5fb-768c25d8be85 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:30.002055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-68fbb6af-1a53-48d1-b5fb-768c25d8be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:30.080563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbb6af-1a53-48d1-b5fb-768c25d8be85 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:30.086197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e6f92-c2b1-4934-82bc-efa169a0304c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:30.086850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e6f92-c2b1-4934-82bc-efa169a0304c service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:30.087137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e6f92-c2b1-4934-82bc-efa169a0304c service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:30.087417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e6f92-c2b1-4934-82bc-efa169a0304c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:30.096393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e6f92-c2b1-4934-82bc-efa169a0304c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:30.098041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e6f92-c2b1-4934-82bc-efa169a0304c service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:30.108589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1057/2112] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:30.891109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37663d-8cbf-4d48-bbc7-c227227abbe2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:30.892565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9c37663d-8cbf-4d48-bbc7-c227227abbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:30.969574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37663d-8cbf-4d48-bbc7-c227227abbe2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:30.974335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:30.975206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:30.975490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:30.975767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] PATH_INFO: `/v3/users/f853f73c6c974a119376f4359c00f144` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:30.977037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f853f73c6c974a119376f4359c00f144)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:30.978957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:31.187657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f853f73c6c974a119376f4359c00f144'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:31.194544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f853f73c6c974a119376f4359c00f144'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:31.275566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f853f73c6c974a119376f4359c00f144'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:31.276211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f853f73c6c974a119376f4359c00f144'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:31.289547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f853f73c6c974a119376f4359c00f144'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:31.295735 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1056/2113] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:30 2022] DELETE /identity/v3/users/f853f73c6c974a119376f4359c00f144 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:31.300415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f282-2b4e-4b87-b84c-98cecd6ebd61 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:31.300885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f282-2b4e-4b87-b84c-98cecd6ebd61 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:31.300962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f282-2b4e-4b87-b84c-98cecd6ebd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:31.329302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6d70f282-2b4e-4b87-b84c-98cecd6ebd61 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:31.330521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6d70f282-2b4e-4b87-b84c-98cecd6ebd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:31.399244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1058/2114] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:31.408325 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:31.409809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:31.417573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:31.473922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f1c1-98b2-49d5-8851-bd0780a81848 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:31.477401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d568242-a44c-4053-a779-0895630fe786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:31.478052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d568242-a44c-4053-a779-0895630fe786 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:31.478359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d568242-a44c-4053-a779-0895630fe786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:31.478640 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d568242-a44c-4053-a779-0895630fe786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:31.488146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d568242-a44c-4053-a779-0895630fe786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:31.489624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d568242-a44c-4053-a779-0895630fe786 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:31.499990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1057/2115] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:31.997242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70f282-2b4e-4b87-b84c-98cecd6ebd61 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:31.999487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6d70f282-2b4e-4b87-b84c-98cecd6ebd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:32.012378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70f282-2b4e-4b87-b84c-98cecd6ebd61 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:32.018354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:32.018354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:32.018604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:32.018776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] PATH_INFO: `/v3/users/28332786f16c4396a64d4c0645081e86` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:32.019980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28332786f16c4396a64d4c0645081e86)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:32.021903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:32.112855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d568242-a44c-4053-a779-0895630fe786 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:32.115353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7d568242-a44c-4053-a779-0895630fe786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:32.137839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d568242-a44c-4053-a779-0895630fe786 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:32.152111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:32.152111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:32.152111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:32.152111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] PATH_INFO: `/v3/projects/80e8b62191f343cd952001c53eb33dd8` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:32.152712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e8b62191f343cd952001c53eb33dd8)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:32.154717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:32.233522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28332786f16c4396a64d4c0645081e86'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.235554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:32.241127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28332786f16c4396a64d4c0645081e86'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.241746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28332786f16c4396a64d4c0645081e86'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.254510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28332786f16c4396a64d4c0645081e86'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.293916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e8b62191f343cd952001c53eb33dd8', 'request_id': 'req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.306837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e8b62191f343cd952001c53eb33dd8', 'request_id': 'req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.313599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e8b62191f343cd952001c53eb33dd8', 'request_id': 'req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.360411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2c776202-7796-4a54-b421-10c12d2a7501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28332786f16c4396a64d4c0645081e86'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.367262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1059/2116] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:31 2022] DELETE /identity/v3/users/28332786f16c4396a64d4c0645081e86 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:32.371373 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15927434-f704-4fa9-bb06-a0876303121b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:32.371665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15927434-f704-4fa9-bb06-a0876303121b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:32.371975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15927434-f704-4fa9-bb06-a0876303121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:32.389730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-15927434-f704-4fa9-bb06-a0876303121b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:32.390975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-15927434-f704-4fa9-bb06-a0876303121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:32.452404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] The token cache is being invalidate because project 80e8b62191f343cd952001c53eb33dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:32.452708 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.453319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.458048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1058/2117] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:32 2022] DELETE /identity/v3/projects/80e8b62191f343cd952001c53eb33dd8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:32.458897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:32.459107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1060/2118] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:32.460341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:32.470770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15927434-f704-4fa9-bb06-a0876303121b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:32.472397 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-15927434-f704-4fa9-bb06-a0876303121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:32.543891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dc2a6-97c0-4c5d-b4f9-4b445904e153 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:32.548016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15927434-f704-4fa9-bb06-a0876303121b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:32.549806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:32.550694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:32.550972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:32.551241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] PATH_INFO: `/v3/users/01c2be33cce9491d91f75188df2f248e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:32.552683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d2bd-a81f-4901-807e-ce23cd327e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:32.552859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c2be33cce9491d91f75188df2f248e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:32.553400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d2bd-a81f-4901-807e-ce23cd327e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:32.553718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d2bd-a81f-4901-807e-ce23cd327e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:32.553999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d2bd-a81f-4901-807e-ce23cd327e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:32.554781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:32.565189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054d2bd-a81f-4901-807e-ce23cd327e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:32.566716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054d2bd-a81f-4901-807e-ce23cd327e0c service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:32.578765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1061/2119] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:15:32.769460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:32.783682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c2be33cce9491d91f75188df2f248e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.794064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c2be33cce9491d91f75188df2f248e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.885873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c2be33cce9491d91f75188df2f248e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.890388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c2be33cce9491d91f75188df2f248e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.902592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d97ff5f0-5ca8-4d7b-b056-bdf609f1a95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c2be33cce9491d91f75188df2f248e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:32.911267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1059/2120] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:32 2022] DELETE /identity/v3/users/01c2be33cce9491d91f75188df2f248e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:33.015021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d2bd-a81f-4901-807e-ce23cd327e0c service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:33.016996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d054d2bd-a81f-4901-807e-ce23cd327e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:33.033259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d2bd-a81f-4901-807e-ce23cd327e0c service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:33.118907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:33.119815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.120129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.120404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] PATH_INFO: `/v3/projects/63a2b70dd5d343beb6f9396bdebd9a6c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.121578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a2b70dd5d343beb6f9396bdebd9a6c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:33.124087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:33.140798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:33.267005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a2b70dd5d343beb6f9396bdebd9a6c', 'request_id': 'req-2454bf83-0d28-4f07-9bf1-87b72addeeb4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.371295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a2b70dd5d343beb6f9396bdebd9a6c', 'request_id': 'req-2454bf83-0d28-4f07-9bf1-87b72addeeb4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.390039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a2b70dd5d343beb6f9396bdebd9a6c', 'request_id': 'req-2454bf83-0d28-4f07-9bf1-87b72addeeb4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.405915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] The token cache is being invalidate because project 63a2b70dd5d343beb6f9396bdebd9a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:33.406363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.407432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.409749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1062/2121] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:33 2022] DELETE /identity/v3/projects/63a2b70dd5d343beb6f9396bdebd9a6c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:33.414755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268156b-5331-4659-b007-b89cb8b9799c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.415383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268156b-5331-4659-b007-b89cb8b9799c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.415383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268156b-5331-4659-b007-b89cb8b9799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.435509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e268156b-5331-4659-b007-b89cb8b9799c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:33.437806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e268156b-5331-4659-b007-b89cb8b9799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:33.495269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:33.496748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:33.528826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1060/2122] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:33.542767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914e55d-1694-4c83-a25d-27e09f9af896 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.542767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914e55d-1694-4c83-a25d-27e09f9af896 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.542767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914e55d-1694-4c83-a25d-27e09f9af896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.562665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5914e55d-1694-4c83-a25d-27e09f9af896 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:33.563914 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5914e55d-1694-4c83-a25d-27e09f9af896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:33.572476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1061/2123] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:33.580131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914e55d-1694-4c83-a25d-27e09f9af896 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:33.590398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914e55d-1694-4c83-a25d-27e09f9af896 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:33.596487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac0199-8123-407d-ae15-a35e43bfb51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:33.597252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac0199-8123-407d-ae15-a35e43bfb51f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.597889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac0199-8123-407d-ae15-a35e43bfb51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.600627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac0199-8123-407d-ae15-a35e43bfb51f admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.600627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac0199-8123-407d-ae15-a35e43bfb51f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:33.600627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac0199-8123-407d-ae15-a35e43bfb51f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:33.603786 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac0199-8123-407d-ae15-a35e43bfb51f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:33.619414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1062/2124] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:15:33.623328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac0199-8123-407d-ae15-a35e43bfb51f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:33.625401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454bf83-0d28-4f07-9bf1-87b72addeeb4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:33.630613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:33.631509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.631791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.632110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] PATH_INFO: `/v3/projects/2661bd9bba7c41759593a4480132fa73` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.633327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2661bd9bba7c41759593a4480132fa73)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:33.633460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac0199-8123-407d-ae15-a35e43bfb51f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:33.635267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:33.638388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89cb76-e297-43b3-a3f9-9aab5ac24707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:33.639716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89cb76-e297-43b3-a3f9-9aab5ac24707 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.640061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89cb76-e297-43b3-a3f9-9aab5ac24707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.640554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89cb76-e297-43b3-a3f9-9aab5ac24707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.641260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89cb76-e297-43b3-a3f9-9aab5ac24707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:33.643171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89cb76-e297-43b3-a3f9-9aab5ac24707 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:33.711357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1063/2125] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:33 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:33.716483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89cb76-e297-43b3-a3f9-9aab5ac24707 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:33.768666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2661bd9bba7c41759593a4480132fa73', 'request_id': 'req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.798794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89cb76-e297-43b3-a3f9-9aab5ac24707 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:33.810709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:33.852704 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2661bd9bba7c41759593a4480132fa73', 'request_id': 'req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.863345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3add63-d7c4-417f-96a6-962d4abec603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:33.864446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3add63-d7c4-417f-96a6-962d4abec603 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.864559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2661bd9bba7c41759593a4480132fa73', 'request_id': 'req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.864702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3add63-d7c4-417f-96a6-962d4abec603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.865121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3add63-d7c4-417f-96a6-962d4abec603 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.865835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3add63-d7c4-417f-96a6-962d4abec603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:33.868373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3add63-d7c4-417f-96a6-962d4abec603 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:33.876091 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] The token cache is being invalidate because project 2661bd9bba7c41759593a4480132fa73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:33.876544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.878384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e49c960-4e4f-43ce-8d96-1e65b5a2f161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:33.879649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1063/2126] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:33 2022] DELETE /identity/v3/projects/2661bd9bba7c41759593a4480132fa73 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:33.885271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490fab4-26d9-4e3a-9558-8528bf29523c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.885557 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490fab4-26d9-4e3a-9558-8528bf29523c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.885860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490fab4-26d9-4e3a-9558-8528bf29523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.904399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f490fab4-26d9-4e3a-9558-8528bf29523c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:33.907170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f490fab4-26d9-4e3a-9558-8528bf29523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:33.914572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1064/2127] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:33.924362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b4337-601f-4053-85ab-1dfd17c367e6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.925007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b4337-601f-4053-85ab-1dfd17c367e6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.925007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b4337-601f-4053-85ab-1dfd17c367e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.944306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d37b4337-601f-4053-85ab-1dfd17c367e6 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:33.945512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d37b4337-601f-4053-85ab-1dfd17c367e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:33.954150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1065/2128] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:33.957950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b4337-601f-4053-85ab-1dfd17c367e6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:33.973371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b4337-601f-4053-85ab-1dfd17c367e6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:33.978918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958df8cf-c9ba-442e-939d-fde4ab9ab57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:33.979575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958df8cf-c9ba-442e-939d-fde4ab9ab57d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:33.979865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958df8cf-c9ba-442e-939d-fde4ab9ab57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:33.980176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958df8cf-c9ba-442e-939d-fde4ab9ab57d admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:33.980921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958df8cf-c9ba-442e-939d-fde4ab9ab57d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:33.981233 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958df8cf-c9ba-442e-939d-fde4ab9ab57d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:33.983561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958df8cf-c9ba-442e-939d-fde4ab9ab57d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:33.999449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1066/2129] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:15:34.000451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958df8cf-c9ba-442e-939d-fde4ab9ab57d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.006706 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:34.010646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958df8cf-c9ba-442e-939d-fde4ab9ab57d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.015835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31157e18-3f54-44f0-8357-9faaec8d4596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.016729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31157e18-3f54-44f0-8357-9faaec8d4596 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.016965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31157e18-3f54-44f0-8357-9faaec8d4596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.017413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31157e18-3f54-44f0-8357-9faaec8d4596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.018184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31157e18-3f54-44f0-8357-9faaec8d4596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.020060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31157e18-3f54-44f0-8357-9faaec8d4596 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.041352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1064/2130] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:33 2022] POST /identity/v3/users => generated 287 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:34.045990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3add63-d7c4-417f-96a6-962d4abec603 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.047547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2c3add63-d7c4-417f-96a6-962d4abec603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:34.060139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3add63-d7c4-417f-96a6-962d4abec603 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.065197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af86361-ba99-4adc-b56d-2481849f8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.065862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af86361-ba99-4adc-b56d-2481849f8352 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.066183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af86361-ba99-4adc-b56d-2481849f8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.066460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af86361-ba99-4adc-b56d-2481849f8352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.067212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af86361-ba99-4adc-b56d-2481849f8352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.068952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af86361-ba99-4adc-b56d-2481849f8352 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.080201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1065/2131] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:34.084014 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af86361-ba99-4adc-b56d-2481849f8352 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.094838 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af86361-ba99-4adc-b56d-2481849f8352 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.099819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a510b-f2a8-4ae0-ac5a-6e5663cf920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.100524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a510b-f2a8-4ae0-ac5a-6e5663cf920e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.100812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a510b-f2a8-4ae0-ac5a-6e5663cf920e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.101088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a510b-f2a8-4ae0-ac5a-6e5663cf920e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.101832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a510b-f2a8-4ae0-ac5a-6e5663cf920e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.104122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a510b-f2a8-4ae0-ac5a-6e5663cf920e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.122342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1066/2132] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:34.123184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a510b-f2a8-4ae0-ac5a-6e5663cf920e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.137260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a510b-f2a8-4ae0-ac5a-6e5663cf920e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.142815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67868b-84e8-44ec-8a67-6cb7a6651b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.143711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67868b-84e8-44ec-8a67-6cb7a6651b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.144030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67868b-84e8-44ec-8a67-6cb7a6651b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.144309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67868b-84e8-44ec-8a67-6cb7a6651b89 admin admin] PATH_INFO: `/v3/projects/fda391d77624495f9818ef3f194d74bc/users/c0d443b7f57f443ba83a1f56a894c289/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.160882 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67868b-84e8-44ec-8a67-6cb7a6651b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda391d77624495f9818ef3f194d74bc, user_id=c0d443b7f57f443ba83a1f56a894c289, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.163912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1067/2133] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:33 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:34.165193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67868b-84e8-44ec-8a67-6cb7a6651b89 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.166785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31157e18-3f54-44f0-8357-9faaec8d4596 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.235078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31157e18-3f54-44f0-8357-9faaec8d4596 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.239691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a27324-fa9b-406a-a4da-f41e2d7f460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.240403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a27324-fa9b-406a-a4da-f41e2d7f460e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.240692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a27324-fa9b-406a-a4da-f41e2d7f460e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.240975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a27324-fa9b-406a-a4da-f41e2d7f460e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.241665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a27324-fa9b-406a-a4da-f41e2d7f460e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.243583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a27324-fa9b-406a-a4da-f41e2d7f460e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.304507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1067/2134] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:34 2022] PUT /identity/v3/projects/fda391d77624495f9818ef3f194d74bc/users/c0d443b7f57f443ba83a1f56a894c289/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:34.315098 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba47ca-5e7d-46f3-acde-f9192326276e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.315368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba47ca-5e7d-46f3-acde-f9192326276e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.315646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba47ca-5e7d-46f3-acde-f9192326276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.350444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2fba47ca-5e7d-46f3-acde-f9192326276e None None] MFA Rules not processed for user `c0d443b7f57f443ba83a1f56a894c289`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:34.351773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2fba47ca-5e7d-46f3-acde-f9192326276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:34.367378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1068/2135] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:34 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:34.371508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a27324-fa9b-406a-a4da-f41e2d7f460e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.385790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a27324-fa9b-406a-a4da-f41e2d7f460e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.441600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1068/2136] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:34.452886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba47ca-5e7d-46f3-acde-f9192326276e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.454819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2fba47ca-5e7d-46f3-acde-f9192326276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:34.461097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35bbb3-e268-4bff-afef-4a3791945a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.462183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35bbb3-e268-4bff-afef-4a3791945a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.462741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35bbb3-e268-4bff-afef-4a3791945a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.463031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35bbb3-e268-4bff-afef-4a3791945a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.463788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35bbb3-e268-4bff-afef-4a3791945a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.465478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35bbb3-e268-4bff-afef-4a3791945a4c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.480113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1069/2137] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:34.485541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35bbb3-e268-4bff-afef-4a3791945a4c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.496591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35bbb3-e268-4bff-afef-4a3791945a4c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.506901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d282b-556a-4021-95c4-2c471b0ec4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.506901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d282b-556a-4021-95c4-2c471b0ec4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.506901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d282b-556a-4021-95c4-2c471b0ec4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.506901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d282b-556a-4021-95c4-2c471b0ec4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.507312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d282b-556a-4021-95c4-2c471b0ec4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.507312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d282b-556a-4021-95c4-2c471b0ec4f4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.524444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1070/2138] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:34.528122 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d282b-556a-4021-95c4-2c471b0ec4f4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.531660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba47ca-5e7d-46f3-acde-f9192326276e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.535654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce69a5f-5881-4cbe-984a-bc4c7e4a290c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.536444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69a5f-5881-4cbe-984a-bc4c7e4a290c service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.536656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69a5f-5881-4cbe-984a-bc4c7e4a290c service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.536936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce69a5f-5881-4cbe-984a-bc4c7e4a290c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.544613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d282b-556a-4021-95c4-2c471b0ec4f4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.547120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce69a5f-5881-4cbe-984a-bc4c7e4a290c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.548657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce69a5f-5881-4cbe-984a-bc4c7e4a290c service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.555542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9f5c1-aaea-4201-8b96-6d3231adc2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.555542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f5c1-aaea-4201-8b96-6d3231adc2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.556580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f5c1-aaea-4201-8b96-6d3231adc2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.556974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9f5c1-aaea-4201-8b96-6d3231adc2cb admin admin] PATH_INFO: `/v3/projects/b8e65ea576a645748ef99094290a897b/users/8b50ef29cd3048b280d533a9621a37d0/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.559111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1069/2139] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:34.582743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9f5c1-aaea-4201-8b96-6d3231adc2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e65ea576a645748ef99094290a897b, user_id=8b50ef29cd3048b280d533a9621a37d0, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.585726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9f5c1-aaea-4201-8b96-6d3231adc2cb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.661241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1071/2140] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:34 2022] PUT /identity/v3/projects/b8e65ea576a645748ef99094290a897b/users/8b50ef29cd3048b280d533a9621a37d0/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:34.673403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cd8a8-2bec-47a2-a3c2-dbd72b8ca3ca None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.673723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cd8a8-2bec-47a2-a3c2-dbd72b8ca3ca None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.674021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cd8a8-2bec-47a2-a3c2-dbd72b8ca3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.703842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-590cd8a8-2bec-47a2-a3c2-dbd72b8ca3ca None None] MFA Rules not processed for user `8b50ef29cd3048b280d533a9621a37d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:34.705084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-590cd8a8-2bec-47a2-a3c2-dbd72b8ca3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:34.714625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:34.783713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1070/2141] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:34.788432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9f5c1-aaea-4201-8b96-6d3231adc2cb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.830030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:34.859614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9f5c1-aaea-4201-8b96-6d3231adc2cb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:34.864959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0f1a-5cf2-4cb8-8e00-d608b477c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:34.865650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0f1a-5cf2-4cb8-8e00-d608b477c308 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:34.865920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0f1a-5cf2-4cb8-8e00-d608b477c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:34.866196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0f1a-5cf2-4cb8-8e00-d608b477c308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:34.866916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b0f1a-5cf2-4cb8-8e00-d608b477c308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:34.868968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b0f1a-5cf2-4cb8-8e00-d608b477c308 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:34.975573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1072/2142] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:34 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:34.980093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cd8a8-2bec-47a2-a3c2-dbd72b8ca3ca None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:34.991734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cd8a8-2bec-47a2-a3c2-dbd72b8ca3ca None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:35.072277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de795e4-761a-4b03-9a61-f2dc1d79fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:35.072966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de795e4-761a-4b03-9a61-f2dc1d79fe2a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:35.073253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de795e4-761a-4b03-9a61-f2dc1d79fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:35.073538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de795e4-761a-4b03-9a61-f2dc1d79fe2a admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:35.074239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de795e4-761a-4b03-9a61-f2dc1d79fe2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:35.077012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de795e4-761a-4b03-9a61-f2dc1d79fe2a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:35.244106 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1071/2143] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:34 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:35.244989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0f1a-5cf2-4cb8-8e00-d608b477c308 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:35.255955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0f1a-5cf2-4cb8-8e00-d608b477c308 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:35.271332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82775d-42d5-4079-b6d7-e736a063a79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:35.271332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82775d-42d5-4079-b6d7-e736a063a79e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:35.271332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82775d-42d5-4079-b6d7-e736a063a79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:35.271639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82775d-42d5-4079-b6d7-e736a063a79e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:35.272342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82775d-42d5-4079-b6d7-e736a063a79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:35.273931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82775d-42d5-4079-b6d7-e736a063a79e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:35.286075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1073/2144] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:35.290478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de795e4-761a-4b03-9a61-f2dc1d79fe2a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:35.301057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de795e4-761a-4b03-9a61-f2dc1d79fe2a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:35.305940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc681b-796a-4183-8826-fbd229b6ca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:35.306903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc681b-796a-4183-8826-fbd229b6ca97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:35.307181 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc681b-796a-4183-8826-fbd229b6ca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:35.307458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc681b-796a-4183-8826-fbd229b6ca97 admin admin] PATH_INFO: `/v3/projects/715cf4f8c28a4e1fa97b2b5dd9c6ebf3/users/05a9bd890bb2420c83a1133b1639f71c/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:35.335067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc681b-796a-4183-8826-fbd229b6ca97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715cf4f8c28a4e1fa97b2b5dd9c6ebf3, user_id=05a9bd890bb2420c83a1133b1639f71c, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:35.337955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc681b-796a-4183-8826-fbd229b6ca97 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:35.419995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1072/2145] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:35 2022] PUT /identity/v3/projects/715cf4f8c28a4e1fa97b2b5dd9c6ebf3/users/05a9bd890bb2420c83a1133b1639f71c/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:35.422470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82775d-42d5-4079-b6d7-e736a063a79e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:35.447217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82775d-42d5-4079-b6d7-e736a063a79e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:35.513653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc402f8-4f4e-4f0a-9048-8319be1c4e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:35.515003 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc402f8-4f4e-4f0a-9048-8319be1c4e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:35.515290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc402f8-4f4e-4f0a-9048-8319be1c4e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:35.515554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc402f8-4f4e-4f0a-9048-8319be1c4e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:35.516334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc402f8-4f4e-4f0a-9048-8319be1c4e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:35.518010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc402f8-4f4e-4f0a-9048-8319be1c4e85 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:35.530583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1074/2146] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:35.534436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc681b-796a-4183-8826-fbd229b6ca97 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:35.545035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc681b-796a-4183-8826-fbd229b6ca97 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:35.549896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c2a4-8edd-431d-a769-f70f91734ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:35.550780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c2a4-8edd-431d-a769-f70f91734ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:35.551061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c2a4-8edd-431d-a769-f70f91734ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:35.551334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977c2a4-8edd-431d-a769-f70f91734ba2 admin admin] PATH_INFO: `/v3/projects/715cf4f8c28a4e1fa97b2b5dd9c6ebf3/users/05a9bd890bb2420c83a1133b1639f71c/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:35.553333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977c2a4-8edd-431d-a769-f70f91734ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715cf4f8c28a4e1fa97b2b5dd9c6ebf3, user_id=05a9bd890bb2420c83a1133b1639f71c, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:35.556149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977c2a4-8edd-431d-a769-f70f91734ba2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:35.567737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1073/2147] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:35 2022] PUT /identity/v3/projects/715cf4f8c28a4e1fa97b2b5dd9c6ebf3/users/05a9bd890bb2420c83a1133b1639f71c/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:35.580494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613dc9-a64b-4692-ad25-1cbe892ba97f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:35.580494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613dc9-a64b-4692-ad25-1cbe892ba97f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:35.580494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613dc9-a64b-4692-ad25-1cbe892ba97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:35.608852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c1613dc9-a64b-4692-ad25-1cbe892ba97f None None] MFA Rules not processed for user `05a9bd890bb2420c83a1133b1639f71c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:35.610188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c1613dc9-a64b-4692-ad25-1cbe892ba97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:35.701653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1075/2148] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:35.714634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c2a4-8edd-431d-a769-f70f91734ba2 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:35.722450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9977c2a4-8edd-431d-a769-f70f91734ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:35.778403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977c2a4-8edd-431d-a769-f70f91734ba2 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:35.782165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031083-d01b-47e0-9ed1-98f59d7c6972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:35.782820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031083-d01b-47e0-9ed1-98f59d7c6972 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:35.783103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031083-d01b-47e0-9ed1-98f59d7c6972 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:35.783380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031083-d01b-47e0-9ed1-98f59d7c6972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:35.794019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031083-d01b-47e0-9ed1-98f59d7c6972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:35.796360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031083-d01b-47e0-9ed1-98f59d7c6972 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:35.804155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:35.809392 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1074/2149] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:36.018337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613dc9-a64b-4692-ad25-1cbe892ba97f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:36.033076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613dc9-a64b-4692-ad25-1cbe892ba97f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:36.036966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00927e9f-4c8a-4b94-aa42-c5f861b3ef76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:36.037997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00927e9f-4c8a-4b94-aa42-c5f861b3ef76 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:36.039791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00927e9f-4c8a-4b94-aa42-c5f861b3ef76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:36.039791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00927e9f-4c8a-4b94-aa42-c5f861b3ef76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:36.112681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00927e9f-4c8a-4b94-aa42-c5f861b3ef76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:36.114275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00927e9f-4c8a-4b94-aa42-c5f861b3ef76 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:36.124905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1076/2150] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:36.200323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:36.680337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031083-d01b-47e0-9ed1-98f59d7c6972 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:36.754477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031083-d01b-47e0-9ed1-98f59d7c6972 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:36.759332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:36.760463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:36.761396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:36.761670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] PATH_INFO: `/v3/users/8b50ef29cd3048b280d533a9621a37d0` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:36.762869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b50ef29cd3048b280d533a9621a37d0)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:36.765096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:36.987608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b50ef29cd3048b280d533a9621a37d0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:36.996975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b50ef29cd3048b280d533a9621a37d0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:37.069909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b50ef29cd3048b280d533a9621a37d0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:37.070604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b50ef29cd3048b280d533a9621a37d0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:37.088471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b50ef29cd3048b280d533a9621a37d0'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:37.095249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1075/2151] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:36 2022] DELETE /identity/v3/users/8b50ef29cd3048b280d533a9621a37d0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:37.100781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05384f7-7c08-4d23-bed5-e2d2f2c801a9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:37.100781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05384f7-7c08-4d23-bed5-e2d2f2c801a9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:37.100781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05384f7-7c08-4d23-bed5-e2d2f2c801a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:37.123741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e05384f7-7c08-4d23-bed5-e2d2f2c801a9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:37.126349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e05384f7-7c08-4d23-bed5-e2d2f2c801a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:37.206450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1077/2152] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:37.216788 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:37.218837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:37.276241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862112c-603c-46c5-97ea-2d04c2a5f9ac admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:37.280587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0fd18-e3ba-4055-b0e1-c27f316ef6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:37.281311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0fd18-e3ba-4055-b0e1-c27f316ef6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:37.281597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0fd18-e3ba-4055-b0e1-c27f316ef6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:37.281874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0fd18-e3ba-4055-b0e1-c27f316ef6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:37.291174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0fd18-e3ba-4055-b0e1-c27f316ef6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:37.292740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0fd18-e3ba-4055-b0e1-c27f316ef6c1 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:37.296717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:37.302720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1076/2153] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:37.779938 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05384f7-7c08-4d23-bed5-e2d2f2c801a9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:37.781342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e05384f7-7c08-4d23-bed5-e2d2f2c801a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:37.794277 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05384f7-7c08-4d23-bed5-e2d2f2c801a9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:37.800346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:37.800477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:37.806203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:37.806507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] PATH_INFO: `/v3/projects/b8e65ea576a645748ef99094290a897b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:37.808446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e65ea576a645748ef99094290a897b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:37.811861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:37.928767 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e65ea576a645748ef99094290a897b', 'request_id': 'req-61407243-0d78-4c02-8a16-f54bb093e661'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.029839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e65ea576a645748ef99094290a897b', 'request_id': 'req-61407243-0d78-4c02-8a16-f54bb093e661'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.037707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e65ea576a645748ef99094290a897b', 'request_id': 'req-61407243-0d78-4c02-8a16-f54bb093e661'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.049464 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] The token cache is being invalidate because project b8e65ea576a645748ef99094290a897b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:38.049751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.050426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.052124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1078/2154] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:37 2022] DELETE /identity/v3/projects/b8e65ea576a645748ef99094290a897b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:38.056168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0fd18-e3ba-4055-b0e1-c27f316ef6c1 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:38.066644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0fd18-e3ba-4055-b0e1-c27f316ef6c1 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:38.127329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:38.128242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:38.128661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:38.128940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] PATH_INFO: `/v3/users/05a9bd890bb2420c83a1133b1639f71c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:38.130150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a9bd890bb2420c83a1133b1639f71c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:38.132259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:38.313898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a9bd890bb2420c83a1133b1639f71c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.321230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a9bd890bb2420c83a1133b1639f71c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.390613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a9bd890bb2420c83a1133b1639f71c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.391234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a9bd890bb2420c83a1133b1639f71c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.404108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70835d38-fb2c-46aa-b3e9-c374d8619e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a9bd890bb2420c83a1133b1639f71c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.420091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1077/2155] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:38 2022] DELETE /identity/v3/users/05a9bd890bb2420c83a1133b1639f71c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:38.435423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:38.437786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:38.454043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61407243-0d78-4c02-8a16-f54bb093e661 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:38.512081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:38.524138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:38.525113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:38.525500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:38.525890 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] PATH_INFO: `/v3/users/02c9cda3368a467d90b442d8348b6d80` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:38.527238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c9cda3368a467d90b442d8348b6d80)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:38.529275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:38.738605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c9cda3368a467d90b442d8348b6d80'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.745991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c9cda3368a467d90b442d8348b6d80'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.746678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c9cda3368a467d90b442d8348b6d80'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.759047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c9cda3368a467d90b442d8348b6d80'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.857084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c9cda3368a467d90b442d8348b6d80'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:38.869568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1079/2156] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:38 2022] DELETE /identity/v3/users/02c9cda3368a467d90b442d8348b6d80 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:38.870792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31de03f-8068-4f8a-a603-48cfd628b513 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:38.871104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31de03f-8068-4f8a-a603-48cfd628b513 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:38.871826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31de03f-8068-4f8a-a603-48cfd628b513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:38.878099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:38.880736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:38.902798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c31de03f-8068-4f8a-a603-48cfd628b513 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:38.903312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c31de03f-8068-4f8a-a603-48cfd628b513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:38.991208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64b47d-776b-4a71-8799-5a68d1d41cd1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:38.995906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:38.996775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:38.997063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:38.997339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] PATH_INFO: `/v3/projects/715cf4f8c28a4e1fa97b2b5dd9c6ebf3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.000331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715cf4f8c28a4e1fa97b2b5dd9c6ebf3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:39.001349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:39.003336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1078/2157] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:39.022088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31de03f-8068-4f8a-a603-48cfd628b513 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:39.023608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c31de03f-8068-4f8a-a603-48cfd628b513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:39.045605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:39.086330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31de03f-8068-4f8a-a603-48cfd628b513 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:39.090147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a8a0-ada0-46f9-8f56-b6f8a0988562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:39.090832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a8a0-ada0-46f9-8f56-b6f8a0988562 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.091161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a8a0-ada0-46f9-8f56-b6f8a0988562 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.091431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a8a0-ada0-46f9-8f56-b6f8a0988562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.102222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9a8a0-ada0-46f9-8f56-b6f8a0988562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:39.103718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9a8a0-ada0-46f9-8f56-b6f8a0988562 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:39.111515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715cf4f8c28a4e1fa97b2b5dd9c6ebf3', 'request_id': 'req-6f617659-0208-43f7-ae6f-3502648f0fe4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:39.113364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1079/2158] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:39.193816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715cf4f8c28a4e1fa97b2b5dd9c6ebf3', 'request_id': 'req-6f617659-0208-43f7-ae6f-3502648f0fe4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:39.201940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715cf4f8c28a4e1fa97b2b5dd9c6ebf3', 'request_id': 'req-6f617659-0208-43f7-ae6f-3502648f0fe4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:39.213427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:39.218204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] The token cache is being invalidate because project 715cf4f8c28a4e1fa97b2b5dd9c6ebf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:39.218515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:39.231575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f617659-0208-43f7-ae6f-3502648f0fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:39.231575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1080/2159] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:38 2022] DELETE /identity/v3/projects/715cf4f8c28a4e1fa97b2b5dd9c6ebf3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:39.232591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50eac9-c155-4696-9ba8-d1b1160ec69e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.232591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50eac9-c155-4696-9ba8-d1b1160ec69e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.232591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50eac9-c155-4696-9ba8-d1b1160ec69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.247434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-dc50eac9-c155-4696-9ba8-d1b1160ec69e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:39.249390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-dc50eac9-c155-4696-9ba8-d1b1160ec69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:39.312780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1080/2160] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:39.320882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8652b-5d16-4bc3-a327-bcfd9ccac359 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.321402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8652b-5d16-4bc3-a327-bcfd9ccac359 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.321917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8652b-5d16-4bc3-a327-bcfd9ccac359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.348931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dda8652b-5d16-4bc3-a327-bcfd9ccac359 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:39.350242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dda8652b-5d16-4bc3-a327-bcfd9ccac359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:39.360956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1081/2161] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:39.365788 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50eac9-c155-4696-9ba8-d1b1160ec69e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:39.381609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50eac9-c155-4696-9ba8-d1b1160ec69e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:39.387815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:39.389211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.392129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.392129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.392129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:39.392129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:39.393244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:39.413531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8652b-5d16-4bc3-a327-bcfd9ccac359 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:39.420620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1081/2162] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:39.424218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8652b-5d16-4bc3-a327-bcfd9ccac359 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:39.429457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7312c5-0665-4f99-90b0-5037a517de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:39.430207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7312c5-0665-4f99-90b0-5037a517de64 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.430883 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7312c5-0665-4f99-90b0-5037a517de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.431265 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7312c5-0665-4f99-90b0-5037a517de64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.432170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7312c5-0665-4f99-90b0-5037a517de64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:39.435488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7312c5-0665-4f99-90b0-5037a517de64 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:39.541969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:39.548459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:39.552673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1082/2163] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:39 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:39.557199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7312c5-0665-4f99-90b0-5037a517de64 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:39.567513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78152f8e-d513-41ff-93cb-e7a4aeb6835c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:39.629338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:39.630124 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.630385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.630664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] PATH_INFO: `/v3/projects/adb4f0ee86924ed9b4b17030701c6947` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.631896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb4f0ee86924ed9b4b17030701c6947)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:39.633812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:39.636787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7312c5-0665-4f99-90b0-5037a517de64 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:39.642411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150859a-383f-4e77-b676-ed5451f29322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:39.643182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150859a-383f-4e77-b676-ed5451f29322 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.643532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150859a-383f-4e77-b676-ed5451f29322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.643901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150859a-383f-4e77-b676-ed5451f29322 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.644695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150859a-383f-4e77-b676-ed5451f29322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:39.646871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150859a-383f-4e77-b676-ed5451f29322 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:39.756311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1083/2164] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:39 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:39.760289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150859a-383f-4e77-b676-ed5451f29322 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:39.770462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150859a-383f-4e77-b676-ed5451f29322 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:39.775372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae772f18-aab7-48f8-8519-ccf9560b1d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:39.776060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae772f18-aab7-48f8-8519-ccf9560b1d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.776370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae772f18-aab7-48f8-8519-ccf9560b1d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.776667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae772f18-aab7-48f8-8519-ccf9560b1d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.777392 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae772f18-aab7-48f8-8519-ccf9560b1d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:39.779000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae772f18-aab7-48f8-8519-ccf9560b1d95 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:39.789362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1084/2165] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:39.793226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae772f18-aab7-48f8-8519-ccf9560b1d95 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:39.803331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae772f18-aab7-48f8-8519-ccf9560b1d95 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:39.808040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c13094-f47f-4fbb-8ec2-652be5f2bac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:39.808689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c13094-f47f-4fbb-8ec2-652be5f2bac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.808970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c13094-f47f-4fbb-8ec2-652be5f2bac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.809246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c13094-f47f-4fbb-8ec2-652be5f2bac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.810021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c13094-f47f-4fbb-8ec2-652be5f2bac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:39.812618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c13094-f47f-4fbb-8ec2-652be5f2bac5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:39.824219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1085/2166] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:39.829509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c13094-f47f-4fbb-8ec2-652be5f2bac5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:39.837814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb4f0ee86924ed9b4b17030701c6947', 'request_id': 'req-7d9a6913-4102-4f92-9a8f-3c167165d4cb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:39.839472 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:39.841293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c13094-f47f-4fbb-8ec2-652be5f2bac5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:39.851695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb4f0ee86924ed9b4b17030701c6947', 'request_id': 'req-7d9a6913-4102-4f92-9a8f-3c167165d4cb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:39.858599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb4f0ee86924ed9b4b17030701c6947', 'request_id': 'req-7d9a6913-4102-4f92-9a8f-3c167165d4cb'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:39.904635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace45a65-aeac-4cf6-b148-7ca58b134896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:39.905542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace45a65-aeac-4cf6-b148-7ca58b134896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:39.905831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace45a65-aeac-4cf6-b148-7ca58b134896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:39.906110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace45a65-aeac-4cf6-b148-7ca58b134896 admin admin] PATH_INFO: `/v3/projects/b17b3b2bc1bd44238526e043b41ed730/users/048793ff882e49bfb36fd7306c7032ba/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:39.922581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace45a65-aeac-4cf6-b148-7ca58b134896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17b3b2bc1bd44238526e043b41ed730, user_id=048793ff882e49bfb36fd7306c7032ba, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:39.925329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace45a65-aeac-4cf6-b148-7ca58b134896 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.023221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] The token cache is being invalidate because project adb4f0ee86924ed9b4b17030701c6947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:40.023536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.024197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.025783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1082/2167] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:39 2022] DELETE /identity/v3/projects/adb4f0ee86924ed9b4b17030701c6947 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:40.026667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.028006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.040722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6913-4102-4f92-9a8f-3c167165d4cb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.045322 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.046193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.046473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.046742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] PATH_INFO: `/v3/users/c0d443b7f57f443ba83a1f56a894c289` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.047956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d443b7f57f443ba83a1f56a894c289)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.049875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.081722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1086/2168] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:39 2022] PUT /identity/v3/projects/b17b3b2bc1bd44238526e043b41ed730/users/048793ff882e49bfb36fd7306c7032ba/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:40.085659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e3a3-6788-4aa2-bc4a-23d59fbe3054 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.085659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e3a3-6788-4aa2-bc4a-23d59fbe3054 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.085659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244e3a3-6788-4aa2-bc4a-23d59fbe3054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.107154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3244e3a3-6788-4aa2-bc4a-23d59fbe3054 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:40.108691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3244e3a3-6788-4aa2-bc4a-23d59fbe3054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.132042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:40.187659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1087/2169] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:40.189207 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a98b4-fbc3-4790-a85b-b6dfa2f04c11 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.189604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a98b4-fbc3-4790-a85b-b6dfa2f04c11 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.189985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a98b4-fbc3-4790-a85b-b6dfa2f04c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.217645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be9a98b4-fbc3-4790-a85b-b6dfa2f04c11 None None] MFA Rules not processed for user `048793ff882e49bfb36fd7306c7032ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:40.218964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be9a98b4-fbc3-4790-a85b-b6dfa2f04c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.274442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d443b7f57f443ba83a1f56a894c289'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.282583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d443b7f57f443ba83a1f56a894c289'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.296140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1088/2170] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:40.298217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8810a4-e05a-478f-ac1d-738c08588a7e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.298653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8810a4-e05a-478f-ac1d-738c08588a7e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.298928 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8810a4-e05a-478f-ac1d-738c08588a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.318613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cb8810a4-e05a-478f-ac1d-738c08588a7e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:40.319812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cb8810a4-e05a-478f-ac1d-738c08588a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.329406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1089/2171] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:40.335827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8810a4-e05a-478f-ac1d-738c08588a7e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.335827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cb8810a4-e05a-478f-ac1d-738c08588a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.355386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d443b7f57f443ba83a1f56a894c289'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.356288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d443b7f57f443ba83a1f56a894c289'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.370495 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d443b7f57f443ba83a1f56a894c289'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.377842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1083/2172] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:40 2022] DELETE /identity/v3/users/c0d443b7f57f443ba83a1f56a894c289 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:40.378529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.379944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.390972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8810a4-e05a-478f-ac1d-738c08588a7e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.442334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.443054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.443054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.443318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.444605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6174a4b-cf4b-41c0-a549-67e5a5c579c6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.445865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.449309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea018b44-71d3-45df-9612-aa4b66c8c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.449984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea018b44-71d3-45df-9612-aa4b66c8c4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.450263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea018b44-71d3-45df-9612-aa4b66c8c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.450580 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea018b44-71d3-45df-9612-aa4b66c8c4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.451334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea018b44-71d3-45df-9612-aa4b66c8c4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:40.451641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea018b44-71d3-45df-9612-aa4b66c8c4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.453319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea018b44-71d3-45df-9612-aa4b66c8c4d6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.461811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:40.464936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1084/2173] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:40.466242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8c32-e21a-4b67-b396-aea7e48e47b0 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.466529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8c32-e21a-4b67-b396-aea7e48e47b0 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.466835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8c32-e21a-4b67-b396-aea7e48e47b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.485685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8c8d8c32-e21a-4b67-b396-aea7e48e47b0 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:40.486888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8c8d8c32-e21a-4b67-b396-aea7e48e47b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.494851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1085/2174] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:40.495608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8c32-e21a-4b67-b396-aea7e48e47b0 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.512343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8c32-e21a-4b67-b396-aea7e48e47b0 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.515320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.516789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.517262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72eac9-88ed-4906-b435-353552ff66b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.517923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72eac9-88ed-4906-b435-353552ff66b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.518200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72eac9-88ed-4906-b435-353552ff66b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.518470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72eac9-88ed-4906-b435-353552ff66b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.519203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72eac9-88ed-4906-b435-353552ff66b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.521334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72eac9-88ed-4906-b435-353552ff66b6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.526423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1090/2175] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:40.527252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.528612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.591243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e043bf-da0c-47ea-bc08-67b192b28422 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.595625 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1863d6-411b-48bf-85d2-e732b831b737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.596367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1863d6-411b-48bf-85d2-e732b831b737 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.596649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1863d6-411b-48bf-85d2-e732b831b737 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.596920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1863d6-411b-48bf-85d2-e732b831b737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.606512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1863d6-411b-48bf-85d2-e732b831b737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.608580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1863d6-411b-48bf-85d2-e732b831b737 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.618894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1091/2176] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:40.619708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1863d6-411b-48bf-85d2-e732b831b737 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.621325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7a1863d6-411b-48bf-85d2-e732b831b737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:40.631027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1086/2177] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:40 2022] POST /identity/v3/projects => generated 359 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:40.632249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72eac9-88ed-4906-b435-353552ff66b6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.634127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1863d6-411b-48bf-85d2-e732b831b737 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.653785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:40.702612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.703408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.703692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.704013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] PATH_INFO: `/v3/users/048793ff882e49bfb36fd7306c7032ba` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.705282 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=048793ff882e49bfb36fd7306c7032ba)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.706771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72eac9-88ed-4906-b435-353552ff66b6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.707261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.712782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809da60-cdee-403f-a7c3-83915b2a2681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.713653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809da60-cdee-403f-a7c3-83915b2a2681 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.714648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809da60-cdee-403f-a7c3-83915b2a2681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.714648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809da60-cdee-403f-a7c3-83915b2a2681 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.715075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809da60-cdee-403f-a7c3-83915b2a2681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.717663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809da60-cdee-403f-a7c3-83915b2a2681 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.855172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1087/2178] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:40 2022] POST /identity/v3/users => generated 280 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:40.857103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809da60-cdee-403f-a7c3-83915b2a2681 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.866635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809da60-cdee-403f-a7c3-83915b2a2681 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.871206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5037-c531-4698-9dcf-5de4154551a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.871830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5037-c531-4698-9dcf-5de4154551a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.872142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5037-c531-4698-9dcf-5de4154551a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.872422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5037-c531-4698-9dcf-5de4154551a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.873740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5037-c531-4698-9dcf-5de4154551a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.875462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5037-c531-4698-9dcf-5de4154551a6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.886835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1088/2179] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:40.891356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5037-c531-4698-9dcf-5de4154551a6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.901958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5037-c531-4698-9dcf-5de4154551a6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.906856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9cd55-5e6e-4de8-8d2c-f3a2325f8db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.907635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9cd55-5e6e-4de8-8d2c-f3a2325f8db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.907944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9cd55-5e6e-4de8-8d2c-f3a2325f8db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.908225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9cd55-5e6e-4de8-8d2c-f3a2325f8db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.908966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9cd55-5e6e-4de8-8d2c-f3a2325f8db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.910608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9cd55-5e6e-4de8-8d2c-f3a2325f8db9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.925149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1089/2180] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:40.936811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9cd55-5e6e-4de8-8d2c-f3a2325f8db9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:40.950249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9cd55-5e6e-4de8-8d2c-f3a2325f8db9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:40.955783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cc88-af05-4418-bc99-b7df2757a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:40.961351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cc88-af05-4418-bc99-b7df2757a090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:40.961351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cc88-af05-4418-bc99-b7df2757a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:40.961351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cc88-af05-4418-bc99-b7df2757a090 admin admin] PATH_INFO: `/v3/projects/906872260a5643f0a28120fe97054389/users/7c5615fc00654eb2bd6d2ccc53eb2d2b/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:40.968232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048793ff882e49bfb36fd7306c7032ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.976341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048793ff882e49bfb36fd7306c7032ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.983137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048793ff882e49bfb36fd7306c7032ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:40.983281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833cc88-af05-4418-bc99-b7df2757a090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906872260a5643f0a28120fe97054389, user_id=7c5615fc00654eb2bd6d2ccc53eb2d2b, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:40.983281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833cc88-af05-4418-bc99-b7df2757a090 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:40.983579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:40.993338 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048793ff882e49bfb36fd7306c7032ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.045882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c4f85e-7c29-4923-8543-f15836d91dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048793ff882e49bfb36fd7306c7032ba'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.053796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1090/2181] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:40 2022] PUT /identity/v3/projects/906872260a5643f0a28120fe97054389/users/7c5615fc00654eb2bd6d2ccc53eb2d2b/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:41.064862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ef12b-662d-45da-924e-d80b18b7fa5d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.065153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ef12b-662d-45da-924e-d80b18b7fa5d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.065434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ef12b-662d-45da-924e-d80b18b7fa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.065689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1092/2182] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:40 2022] DELETE /identity/v3/users/048793ff882e49bfb36fd7306c7032ba => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:41.072897 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf9be8-7a07-44d9-8e66-119c4a36326e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.073298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf9be8-7a07-44d9-8e66-119c4a36326e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.073680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf9be8-7a07-44d9-8e66-119c4a36326e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.097672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9f3ef12b-662d-45da-924e-d80b18b7fa5d None None] MFA Rules not processed for user `7c5615fc00654eb2bd6d2ccc53eb2d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:41.098921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9f3ef12b-662d-45da-924e-d80b18b7fa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:41.109715 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7bcf9be8-7a07-44d9-8e66-119c4a36326e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:41.111214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7bcf9be8-7a07-44d9-8e66-119c4a36326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:41.183903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1091/2183] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:41.184711 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ef12b-662d-45da-924e-d80b18b7fa5d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:41.187251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9f3ef12b-662d-45da-924e-d80b18b7fa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:41.188340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1093/2184] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:41.207652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf9be8-7a07-44d9-8e66-119c4a36326e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:41.209208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7bcf9be8-7a07-44d9-8e66-119c4a36326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:41.212858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ef12b-662d-45da-924e-d80b18b7fa5d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:41.218208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:41.219083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.219365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.219642 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] PATH_INFO: `/v3/projects/fda391d77624495f9818ef3f194d74bc` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.220909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda391d77624495f9818ef3f194d74bc)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:41.222817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:41.280807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf9be8-7a07-44d9-8e66-119c4a36326e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:41.284823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098441-dfcc-4590-a4f1-a659e1cabd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:41.286051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098441-dfcc-4590-a4f1-a659e1cabd5e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.286180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098441-dfcc-4590-a4f1-a659e1cabd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.286511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab098441-dfcc-4590-a4f1-a659e1cabd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.304511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab098441-dfcc-4590-a4f1-a659e1cabd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:41.306117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab098441-dfcc-4590-a4f1-a659e1cabd5e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:41.317240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1094/2185] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:41.319929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098441-dfcc-4590-a4f1-a659e1cabd5e service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:41.319929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab098441-dfcc-4590-a4f1-a659e1cabd5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:41.380613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda391d77624495f9818ef3f194d74bc', 'request_id': 'req-6823e7f4-ea38-44c9-aa74-e8567d81af7f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.381806 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:41.387048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda391d77624495f9818ef3f194d74bc', 'request_id': 'req-6823e7f4-ea38-44c9-aa74-e8567d81af7f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.395705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda391d77624495f9818ef3f194d74bc', 'request_id': 'req-6823e7f4-ea38-44c9-aa74-e8567d81af7f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.426827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab098441-dfcc-4590-a4f1-a659e1cabd5e service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:41.462313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:41.477532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd8c85-29f6-4762-beb7-9e21b68c4792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:41.478191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd8c85-29f6-4762-beb7-9e21b68c4792 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.478472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd8c85-29f6-4762-beb7-9e21b68c4792 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.478803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd8c85-29f6-4762-beb7-9e21b68c4792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.497413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] The token cache is being invalidate because project fda391d77624495f9818ef3f194d74bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:41.497538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.498274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6823e7f4-ea38-44c9-aa74-e8567d81af7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.499830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1092/2186] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:41 2022] DELETE /identity/v3/projects/fda391d77624495f9818ef3f194d74bc => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:41.505618 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020497-525a-44ef-a658-0ec1fe6af689 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.505905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020497-525a-44ef-a658-0ec1fe6af689 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.506243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020497-525a-44ef-a658-0ec1fe6af689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.538669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd8c85-29f6-4762-beb7-9e21b68c4792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:41.540150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd8c85-29f6-4762-beb7-9e21b68c4792 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:41.545498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6f020497-525a-44ef-a658-0ec1fe6af689 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:41.546406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6f020497-525a-44ef-a658-0ec1fe6af689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:41.550423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1095/2187] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:41 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:41.566598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd8c85-29f6-4762-beb7-9e21b68c4792 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:41.568126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-45dd8c85-29f6-4762-beb7-9e21b68c4792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:41.626515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1093/2188] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:41.634568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a19e-1c99-4563-9569-97e258639dfc None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.637225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a19e-1c99-4563-9569-97e258639dfc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.637225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a19e-1c99-4563-9569-97e258639dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.657031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6ce6a19e-1c99-4563-9569-97e258639dfc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:41.657947 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd8c85-29f6-4762-beb7-9e21b68c4792 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:41.658505 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6ce6a19e-1c99-4563-9569-97e258639dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:41.662703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:41.663617 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.663930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.664250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] PATH_INFO: `/v3/users/7c5615fc00654eb2bd6d2ccc53eb2d2b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.665416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5615fc00654eb2bd6d2ccc53eb2d2b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:41.667396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1094/2189] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:41.667517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:41.672356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a19e-1c99-4563-9569-97e258639dfc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:41.682295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a19e-1c99-4563-9569-97e258639dfc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:41.688436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a958-0527-44e2-9f42-98c148901f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:41.689097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a958-0527-44e2-9f42-98c148901f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.689417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a958-0527-44e2-9f42-98c148901f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.689790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a958-0527-44e2-9f42-98c148901f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.690512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2a958-0527-44e2-9f42-98c148901f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:41.690823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2a958-0527-44e2-9f42-98c148901f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:41.692761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2a958-0527-44e2-9f42-98c148901f58 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:41.706018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1095/2190] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:15:41.710371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a958-0527-44e2-9f42-98c148901f58 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:41.720791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a958-0527-44e2-9f42-98c148901f58 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:41.725665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3918196-b870-48fc-a35e-01ea8b2d6a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:41.726323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3918196-b870-48fc-a35e-01ea8b2d6a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.726612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3918196-b870-48fc-a35e-01ea8b2d6a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.726915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3918196-b870-48fc-a35e-01ea8b2d6a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.727607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3918196-b870-48fc-a35e-01ea8b2d6a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:41.729700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3918196-b870-48fc-a35e-01ea8b2d6a4a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:41.847555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1096/2191] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:41 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:41.847555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3918196-b870-48fc-a35e-01ea8b2d6a4a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:41.847815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f3918196-b870-48fc-a35e-01ea8b2d6a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:41.922292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3918196-b870-48fc-a35e-01ea8b2d6a4a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:41.927937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:41.928821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:41.929108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:41.929390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] PATH_INFO: `/v3/projects/b17b3b2bc1bd44238526e043b41ed730` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:41.930919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17b3b2bc1bd44238526e043b41ed730)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:41.932902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:41.953817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5615fc00654eb2bd6d2ccc53eb2d2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.961245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5615fc00654eb2bd6d2ccc53eb2d2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.961942 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5615fc00654eb2bd6d2ccc53eb2d2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:41.976660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5615fc00654eb2bd6d2ccc53eb2d2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:42.065121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17b3b2bc1bd44238526e043b41ed730', 'request_id': 'req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:42.071171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17b3b2bc1bd44238526e043b41ed730', 'request_id': 'req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:42.074948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5615fc00654eb2bd6d2ccc53eb2d2b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:42.084429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17b3b2bc1bd44238526e043b41ed730', 'request_id': 'req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:42.084572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1096/2192] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:41 2022] DELETE /identity/v3/users/7c5615fc00654eb2bd6d2ccc53eb2d2b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:42.084572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.084572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:42.149735 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea6c3d-8b7a-46e0-982c-5eb34d8e0098 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.154622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e484-b073-4737-be58-eb8aeae9537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.155843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e484-b073-4737-be58-eb8aeae9537a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.155843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e484-b073-4737-be58-eb8aeae9537a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.156067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e484-b073-4737-be58-eb8aeae9537a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.156712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e484-b073-4737-be58-eb8aeae9537a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.158718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e484-b073-4737-be58-eb8aeae9537a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.211196 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] The token cache is being invalidate because project b17b3b2bc1bd44238526e043b41ed730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:42.211509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:42.212171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ca2ec34a-50c3-4308-ad76-1470fbe9dd04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:42.213782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1097/2193] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:41 2022] DELETE /identity/v3/projects/b17b3b2bc1bd44238526e043b41ed730 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:42.215063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477fb08-9f1c-4e20-9682-592d17050d05 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.215407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477fb08-9f1c-4e20-9682-592d17050d05 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.215687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477fb08-9f1c-4e20-9682-592d17050d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.232598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d477fb08-9f1c-4e20-9682-592d17050d05 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:42.233899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d477fb08-9f1c-4e20-9682-592d17050d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:42.247320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1097/2195] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:42 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:42.247509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1098/2195] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:42.247509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497f10-b97b-4194-9360-98875cca0ac1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.247509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497f10-b97b-4194-9360-98875cca0ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.247509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497f10-b97b-4194-9360-98875cca0ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.250138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e484-b073-4737-be58-eb8aeae9537a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.251817 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cc58e484-b073-4737-be58-eb8aeae9537a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:42.261974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9a497f10-b97b-4194-9360-98875cca0ac1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:42.263144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9a497f10-b97b-4194-9360-98875cca0ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:42.264674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e484-b073-4737-be58-eb8aeae9537a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.269425 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e69181-1002-4d91-84ec-985e8134291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.270084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69181-1002-4d91-84ec-985e8134291d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.270371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69181-1002-4d91-84ec-985e8134291d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.278320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e69181-1002-4d91-84ec-985e8134291d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.278320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e69181-1002-4d91-84ec-985e8134291d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.278526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1099/2196] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:42.278526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497f10-b97b-4194-9360-98875cca0ac1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.278699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e69181-1002-4d91-84ec-985e8134291d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.278794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9a497f10-b97b-4194-9360-98875cca0ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:42.287776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1098/2197] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:42.292179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f66f1a-cf99-4aaa-9e8c-503533b4c424 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.292472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f66f1a-cf99-4aaa-9e8c-503533b4c424 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.292749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f66f1a-cf99-4aaa-9e8c-503533b4c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.313005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-57f66f1a-cf99-4aaa-9e8c-503533b4c424 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:42.314413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-57f66f1a-cf99-4aaa-9e8c-503533b4c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:42.322929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1099/2198] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:42.324887 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f66f1a-cf99-4aaa-9e8c-503533b4c424 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.334626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f66f1a-cf99-4aaa-9e8c-503533b4c424 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.337922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497f10-b97b-4194-9360-98875cca0ac1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.340029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030cbce-7c8f-4723-9f1a-c8d9fe19a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.340689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030cbce-7c8f-4723-9f1a-c8d9fe19a55a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.340972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030cbce-7c8f-4723-9f1a-c8d9fe19a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.341249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030cbce-7c8f-4723-9f1a-c8d9fe19a55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.341790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcef9f-256b-4fb9-850a-4bc2439a8bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.342291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030cbce-7c8f-4723-9f1a-c8d9fe19a55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.342536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcef9f-256b-4fb9-850a-4bc2439a8bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.342820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcef9f-256b-4fb9-850a-4bc2439a8bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.343094 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcef9f-256b-4fb9-850a-4bc2439a8bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.343900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030cbce-7c8f-4723-9f1a-c8d9fe19a55a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.352386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcef9f-256b-4fb9-850a-4bc2439a8bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.357208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcef9f-256b-4fb9-850a-4bc2439a8bf9 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.357586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1100/2199] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:42.357586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030cbce-7c8f-4723-9f1a-c8d9fe19a55a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.363902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1100/2200] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:42.364204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030cbce-7c8f-4723-9f1a-c8d9fe19a55a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.364734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcef9f-256b-4fb9-850a-4bc2439a8bf9 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.369074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f9f8e-b4bc-46a7-888e-d4725c41e828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.369727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f9f8e-b4bc-46a7-888e-d4725c41e828 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.370013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f9f8e-b4bc-46a7-888e-d4725c41e828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.370296 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f9f8e-b4bc-46a7-888e-d4725c41e828 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.371087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f9f8e-b4bc-46a7-888e-d4725c41e828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:42.371824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f9f8e-b4bc-46a7-888e-d4725c41e828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.373881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f9f8e-b4bc-46a7-888e-d4725c41e828 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.374775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcef9f-256b-4fb9-850a-4bc2439a8bf9 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.379834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272ca11-536f-451b-8eab-253a9bb99363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.381097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272ca11-536f-451b-8eab-253a9bb99363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.381097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272ca11-536f-451b-8eab-253a9bb99363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.381765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272ca11-536f-451b-8eab-253a9bb99363 admin admin] PATH_INFO: `/v3/projects/90aa4f8be50a4d06ac3f723ad096c355/users/2c40aee8ff094e9780280ecd443ce114/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.386776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1101/2201] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:42.395653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f9f8e-b4bc-46a7-888e-d4725c41e828 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.400494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272ca11-536f-451b-8eab-253a9bb99363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90aa4f8be50a4d06ac3f723ad096c355, user_id=2c40aee8ff094e9780280ecd443ce114, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.403318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272ca11-536f-451b-8eab-253a9bb99363 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.411312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f9f8e-b4bc-46a7-888e-d4725c41e828 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.419573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30679430-e5d2-44d3-a17a-72da321a9353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.421186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30679430-e5d2-44d3-a17a-72da321a9353 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.421591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30679430-e5d2-44d3-a17a-72da321a9353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.422244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30679430-e5d2-44d3-a17a-72da321a9353 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.423094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30679430-e5d2-44d3-a17a-72da321a9353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.425352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30679430-e5d2-44d3-a17a-72da321a9353 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.504401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1101/2202] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:42 2022] PUT /identity/v3/projects/90aa4f8be50a4d06ac3f723ad096c355/users/2c40aee8ff094e9780280ecd443ce114/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:42.516348 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668a05-6955-4e7c-a076-6fd5448a44cc None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.516625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668a05-6955-4e7c-a076-6fd5448a44cc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.516973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e668a05-6955-4e7c-a076-6fd5448a44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.534668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1102/2203] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:42 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:42.536280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30679430-e5d2-44d3-a17a-72da321a9353 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.559224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0e668a05-6955-4e7c-a076-6fd5448a44cc None None] MFA Rules not processed for user `2c40aee8ff094e9780280ecd443ce114`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:42.560720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0e668a05-6955-4e7c-a076-6fd5448a44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:42.612865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30679430-e5d2-44d3-a17a-72da321a9353 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.621419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4681-d899-4f78-a0c6-67974ace6e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.622164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4681-d899-4f78-a0c6-67974ace6e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.622504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4681-d899-4f78-a0c6-67974ace6e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.622914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4681-d899-4f78-a0c6-67974ace6e1f admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.623845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb4681-d899-4f78-a0c6-67974ace6e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.625892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb4681-d899-4f78-a0c6-67974ace6e1f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.650076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1102/2204] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:42.653064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:42.671341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668a05-6955-4e7c-a076-6fd5448a44cc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.673272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0e668a05-6955-4e7c-a076-6fd5448a44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:42.712749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1103/2205] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:42 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:42.714071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4681-d899-4f78-a0c6-67974ace6e1f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.724912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4681-d899-4f78-a0c6-67974ace6e1f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.730885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b502c7f-52cd-4f6a-a3df-fb0368150012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.732896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b502c7f-52cd-4f6a-a3df-fb0368150012 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.732896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b502c7f-52cd-4f6a-a3df-fb0368150012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.733163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b502c7f-52cd-4f6a-a3df-fb0368150012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.733989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b502c7f-52cd-4f6a-a3df-fb0368150012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.735753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b502c7f-52cd-4f6a-a3df-fb0368150012 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.740758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e668a05-6955-4e7c-a076-6fd5448a44cc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.744672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112c338-f279-463c-92e9-9f52e0669dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.745460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112c338-f279-463c-92e9-9f52e0669dca service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.745813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112c338-f279-463c-92e9-9f52e0669dca service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.746153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112c338-f279-463c-92e9-9f52e0669dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.761573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112c338-f279-463c-92e9-9f52e0669dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.761820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1104/2206] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:42.762365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112c338-f279-463c-92e9-9f52e0669dca service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.763161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b502c7f-52cd-4f6a-a3df-fb0368150012 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.775060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1103/2207] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:15:42.777349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b502c7f-52cd-4f6a-a3df-fb0368150012 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.787797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:42.796215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48cbc2-926e-47f6-859a-dc8e18e78563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.802467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48cbc2-926e-47f6-859a-dc8e18e78563 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.802467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48cbc2-926e-47f6-859a-dc8e18e78563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.802467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48cbc2-926e-47f6-859a-dc8e18e78563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.802467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48cbc2-926e-47f6-859a-dc8e18e78563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.802467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48cbc2-926e-47f6-859a-dc8e18e78563 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.803683 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112c338-f279-463c-92e9-9f52e0669dca service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.813776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1105/2208] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:42.817488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48cbc2-926e-47f6-859a-dc8e18e78563 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.817802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112c338-f279-463c-92e9-9f52e0669dca service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.822667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.823791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.824758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.825044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] PATH_INFO: `/v3/users/2c40aee8ff094e9780280ecd443ce114` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.827220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c40aee8ff094e9780280ecd443ce114)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.829106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48cbc2-926e-47f6-859a-dc8e18e78563 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.829243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.834366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f657b-3dc1-4df3-b5de-d52836063f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.835411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f657b-3dc1-4df3-b5de-d52836063f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.835697 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f657b-3dc1-4df3-b5de-d52836063f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.836010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f657b-3dc1-4df3-b5de-d52836063f56 admin admin] PATH_INFO: `/v3/projects/2b49dcebebed4af58712d5e1394337a0/users/5ba7948690ab4bc5a09a66de44a85b5f/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.851957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f657b-3dc1-4df3-b5de-d52836063f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b49dcebebed4af58712d5e1394337a0, user_id=5ba7948690ab4bc5a09a66de44a85b5f, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.855026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f657b-3dc1-4df3-b5de-d52836063f56 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:42.915943 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1106/2209] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:42 2022] PUT /identity/v3/projects/2b49dcebebed4af58712d5e1394337a0/users/5ba7948690ab4bc5a09a66de44a85b5f/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:42.916759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f657b-3dc1-4df3-b5de-d52836063f56 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:42.918429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-de7f657b-3dc1-4df3-b5de-d52836063f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:42.986574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f657b-3dc1-4df3-b5de-d52836063f56 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:42.992041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:42.992912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:42.993197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:42.993478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] PATH_INFO: `/v3/projects/906872260a5643f0a28120fe97054389` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:42.994692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906872260a5643f0a28120fe97054389)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:42.996687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:43.065987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c40aee8ff094e9780280ecd443ce114'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.072969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c40aee8ff094e9780280ecd443ce114'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.104161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906872260a5643f0a28120fe97054389', 'request_id': 'req-713401ef-dfa3-49ce-9c28-42ecff60e767'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.177523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c40aee8ff094e9780280ecd443ce114'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.178142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c40aee8ff094e9780280ecd443ce114'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.191372 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cc590650-fc11-4124-b291-2625b6887c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c40aee8ff094e9780280ecd443ce114'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.197511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1104/2210] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:42 2022] DELETE /identity/v3/users/2c40aee8ff094e9780280ecd443ce114 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:43.198746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc261789-3217-4004-9964-42b040ec3363 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.199054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc261789-3217-4004-9964-42b040ec3363 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.199347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc261789-3217-4004-9964-42b040ec3363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.218896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906872260a5643f0a28120fe97054389', 'request_id': 'req-713401ef-dfa3-49ce-9c28-42ecff60e767'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.226000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906872260a5643f0a28120fe97054389', 'request_id': 'req-713401ef-dfa3-49ce-9c28-42ecff60e767'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.226656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-dc261789-3217-4004-9964-42b040ec3363 None None] MFA Rules not processed for user `5ba7948690ab4bc5a09a66de44a85b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:43.227886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-dc261789-3217-4004-9964-42b040ec3363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:43.236983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] The token cache is being invalidate because project 906872260a5643f0a28120fe97054389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:43.237275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.237949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-713401ef-dfa3-49ce-9c28-42ecff60e767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:43.239739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1107/2211] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:42 2022] DELETE /identity/v3/projects/906872260a5643f0a28120fe97054389 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:43.241256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb287d-a1ee-4bd2-9898-d05f1fecbb38 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.242308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb287d-a1ee-4bd2-9898-d05f1fecbb38 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.242595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb287d-a1ee-4bd2-9898-d05f1fecbb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.261771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-16fb287d-a1ee-4bd2-9898-d05f1fecbb38 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:43.262972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-16fb287d-a1ee-4bd2-9898-d05f1fecbb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:43.301635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1105/2212] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:43.303070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48e48-1b7a-4153-8427-d7cc8e957e05 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.303520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48e48-1b7a-4153-8427-d7cc8e957e05 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.304183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c48e48-1b7a-4153-8427-d7cc8e957e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.322653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-48c48e48-1b7a-4153-8427-d7cc8e957e05 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:43.323924 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-48c48e48-1b7a-4153-8427-d7cc8e957e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:43.327445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1108/2213] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:43.328215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb287d-a1ee-4bd2-9898-d05f1fecbb38 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:43.329397 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-16fb287d-a1ee-4bd2-9898-d05f1fecbb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:43.336533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1106/2214] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:43.336533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c48e48-1b7a-4153-8427-d7cc8e957e05 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:43.345290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-48c48e48-1b7a-4153-8427-d7cc8e957e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:43.392477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb287d-a1ee-4bd2-9898-d05f1fecbb38 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:43.396416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e0d4-3a50-4912-865b-4995b8607cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:43.397291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e0d4-3a50-4912-865b-4995b8607cec service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.397645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e0d4-3a50-4912-865b-4995b8607cec service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.397995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e0d4-3a50-4912-865b-4995b8607cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.407603 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e0d4-3a50-4912-865b-4995b8607cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:43.407793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c48e48-1b7a-4153-8427-d7cc8e957e05 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:43.409086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e0d4-3a50-4912-865b-4995b8607cec service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:43.411753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a0f2c-0c41-4916-9bb5-990ddae41b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:43.412442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a0f2c-0c41-4916-9bb5-990ddae41b7f service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.412926 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a0f2c-0c41-4916-9bb5-990ddae41b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.413203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a0f2c-0c41-4916-9bb5-990ddae41b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.418803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1109/2215] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:43.419978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4cff0-b4af-4820-9ac7-aa1f88ed02ab None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.420273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4cff0-b4af-4820-9ac7-aa1f88ed02ab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.424451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4cff0-b4af-4820-9ac7-aa1f88ed02ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.425531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a0f2c-0c41-4916-9bb5-990ddae41b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:43.427400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a0f2c-0c41-4916-9bb5-990ddae41b7f service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:43.439857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a6c4cff0-b4af-4820-9ac7-aa1f88ed02ab None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:43.442659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a6c4cff0-b4af-4820-9ac7-aa1f88ed02ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:43.448339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1107/2216] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:43.453382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1110/2217] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:43.457797 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a0f2c-0c41-4916-9bb5-990ddae41b7f service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:43.478101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a0f2c-0c41-4916-9bb5-990ddae41b7f service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:43.490300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314f54b-761d-4616-b6d6-2e91dfe5a4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:43.490998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314f54b-761d-4616-b6d6-2e91dfe5a4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.492089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314f54b-761d-4616-b6d6-2e91dfe5a4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.492089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314f54b-761d-4616-b6d6-2e91dfe5a4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.492517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314f54b-761d-4616-b6d6-2e91dfe5a4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:43.492599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314f54b-761d-4616-b6d6-2e91dfe5a4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:43.495327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314f54b-761d-4616-b6d6-2e91dfe5a4e1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:43.524846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1108/2218] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:43.526458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4cff0-b4af-4820-9ac7-aa1f88ed02ab None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:43.538792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4cff0-b4af-4820-9ac7-aa1f88ed02ab None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:43.543719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc80e22-5f9d-4d5c-b1c6-72ada2d26cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:43.544507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc80e22-5f9d-4d5c-b1c6-72ada2d26cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.545068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc80e22-5f9d-4d5c-b1c6-72ada2d26cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.545420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc80e22-5f9d-4d5c-b1c6-72ada2d26cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.546329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc80e22-5f9d-4d5c-b1c6-72ada2d26cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:43.548509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc80e22-5f9d-4d5c-b1c6-72ada2d26cfb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:43.656881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1111/2219] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:43 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:43.658058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314f54b-761d-4616-b6d6-2e91dfe5a4e1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:43.668386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314f54b-761d-4616-b6d6-2e91dfe5a4e1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:43.729546 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc901f7-151d-475c-a72b-6f320b0abc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:43.730234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc901f7-151d-475c-a72b-6f320b0abc39 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.730516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc901f7-151d-475c-a72b-6f320b0abc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.730791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc901f7-151d-475c-a72b-6f320b0abc39 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.731547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc901f7-151d-475c-a72b-6f320b0abc39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:43.733581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc901f7-151d-475c-a72b-6f320b0abc39 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:43.847967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1109/2220] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:43 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:43.852113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc80e22-5f9d-4d5c-b1c6-72ada2d26cfb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:43.863173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc80e22-5f9d-4d5c-b1c6-72ada2d26cfb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:43.867948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604094a7-4176-4f40-9b79-9d954a5e30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:43.869406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604094a7-4176-4f40-9b79-9d954a5e30c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.869406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604094a7-4176-4f40-9b79-9d954a5e30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.869406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604094a7-4176-4f40-9b79-9d954a5e30c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.870087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604094a7-4176-4f40-9b79-9d954a5e30c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:43.871687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604094a7-4176-4f40-9b79-9d954a5e30c4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:43.883343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1112/2221] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:43.887262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc901f7-151d-475c-a72b-6f320b0abc39 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:43.897906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc901f7-151d-475c-a72b-6f320b0abc39 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:43.902567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7796ea-24ae-49a1-ad8d-0eccba7cbd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:43.903218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7796ea-24ae-49a1-ad8d-0eccba7cbd83 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.903504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7796ea-24ae-49a1-ad8d-0eccba7cbd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.903782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7796ea-24ae-49a1-ad8d-0eccba7cbd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.904575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7796ea-24ae-49a1-ad8d-0eccba7cbd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:43.906176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7796ea-24ae-49a1-ad8d-0eccba7cbd83 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:43.916074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1110/2222] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:43.920637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604094a7-4176-4f40-9b79-9d954a5e30c4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:43.930804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604094a7-4176-4f40-9b79-9d954a5e30c4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:43.937734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6f575-f8e0-403c-b855-be5c25dc8d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:43.938903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6f575-f8e0-403c-b855-be5c25dc8d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.939195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6f575-f8e0-403c-b855-be5c25dc8d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.939513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6f575-f8e0-403c-b855-be5c25dc8d59 admin admin] PATH_INFO: `/v3/projects/4b92480a377940ddb4a4a81fd52b271e/users/41151be95e704592b4a375444409d852/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.951308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7796ea-24ae-49a1-ad8d-0eccba7cbd83 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:43.953829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0c7796ea-24ae-49a1-ad8d-0eccba7cbd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:43.958023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6f575-f8e0-403c-b855-be5c25dc8d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b92480a377940ddb4a4a81fd52b271e, user_id=41151be95e704592b4a375444409d852, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:43.960787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6f575-f8e0-403c-b855-be5c25dc8d59 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:43.975768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7796ea-24ae-49a1-ad8d-0eccba7cbd83 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:43.982132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:43.983977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:43.984408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:43.984690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] PATH_INFO: `/v3/projects/90aa4f8be50a4d06ac3f723ad096c355` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:43.986036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=90aa4f8be50a4d06ac3f723ad096c355)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:43.998539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:44.052576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1113/2223] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:43 2022] PUT /identity/v3/projects/4b92480a377940ddb4a4a81fd52b271e/users/41151be95e704592b4a375444409d852/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:44.063469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4cebc-1884-4e6d-8823-56a7f02cb6f0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:44.063762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4cebc-1884-4e6d-8823-56a7f02cb6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:44.064081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4cebc-1884-4e6d-8823-56a7f02cb6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:44.091968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ddc4cebc-1884-4e6d-8823-56a7f02cb6f0 None None] MFA Rules not processed for user `41151be95e704592b4a375444409d852`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:44.097978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ddc4cebc-1884-4e6d-8823-56a7f02cb6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:44.142131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90aa4f8be50a4d06ac3f723ad096c355', 'request_id': 'req-7ff9b832-1434-455d-93f0-28ae08b7ad4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:44.166619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90aa4f8be50a4d06ac3f723ad096c355', 'request_id': 'req-7ff9b832-1434-455d-93f0-28ae08b7ad4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:44.174728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90aa4f8be50a4d06ac3f723ad096c355', 'request_id': 'req-7ff9b832-1434-455d-93f0-28ae08b7ad4c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:44.185001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1114/2224] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:44.191073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4cebc-1884-4e6d-8823-56a7f02cb6f0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:44.271829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:44.274718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4cebc-1884-4e6d-8823-56a7f02cb6f0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:44.280659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] The token cache is being invalidate because project 90aa4f8be50a4d06ac3f723ad096c355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:44.280659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:44.282164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:44.284096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1111/2225] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:43 2022] DELETE /identity/v3/projects/90aa4f8be50a4d06ac3f723ad096c355 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:44.390566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708ad55-08d3-4bf2-96db-4600c7de69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:44.391670 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708ad55-08d3-4bf2-96db-4600c7de69ff admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:44.392191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708ad55-08d3-4bf2-96db-4600c7de69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:44.392544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708ad55-08d3-4bf2-96db-4600c7de69ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:44.393362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708ad55-08d3-4bf2-96db-4600c7de69ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:44.395512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708ad55-08d3-4bf2-96db-4600c7de69ff admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:44.485746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:44.525081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1115/2226] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:44 2022] POST /identity/v3/projects => generated 383 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:15:44.526172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:44.527606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:44.542230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9b832-1434-455d-93f0-28ae08b7ad4c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:44.600207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d147129-3eb4-45d5-b738-93bc8d20935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:44.600891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d147129-3eb4-45d5-b738-93bc8d20935c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:44.601179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d147129-3eb4-45d5-b738-93bc8d20935c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:44.601462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d147129-3eb4-45d5-b738-93bc8d20935c admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:44.602169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d147129-3eb4-45d5-b738-93bc8d20935c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:44.604125 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d147129-3eb4-45d5-b738-93bc8d20935c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:44.704002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1112/2227] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:44 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:44.707940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708ad55-08d3-4bf2-96db-4600c7de69ff admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:44.718124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708ad55-08d3-4bf2-96db-4600c7de69ff admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:44.722652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353283d-78ef-4628-b19b-227625a3193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:44.723327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353283d-78ef-4628-b19b-227625a3193b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:44.723611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353283d-78ef-4628-b19b-227625a3193b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:44.723914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353283d-78ef-4628-b19b-227625a3193b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:44.724716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353283d-78ef-4628-b19b-227625a3193b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:44.726306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353283d-78ef-4628-b19b-227625a3193b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:44.737115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1116/2228] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:44.743984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d147129-3eb4-45d5-b738-93bc8d20935c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:44.754939 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d147129-3eb4-45d5-b738-93bc8d20935c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:44.760477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8ec11-69b4-4f13-8ecb-578a7ee8be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:44.761128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8ec11-69b4-4f13-8ecb-578a7ee8be4d admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:44.761429 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8ec11-69b4-4f13-8ecb-578a7ee8be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:44.761707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8ec11-69b4-4f13-8ecb-578a7ee8be4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:44.762485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8ec11-69b4-4f13-8ecb-578a7ee8be4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:44.764111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8ec11-69b4-4f13-8ecb-578a7ee8be4d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:44.774245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1113/2229] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:44.778549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353283d-78ef-4628-b19b-227625a3193b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:44.790433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353283d-78ef-4628-b19b-227625a3193b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:44.795631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ae8cf-642b-468a-a1bb-18a0e37c7878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:44.799762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae8cf-642b-468a-a1bb-18a0e37c7878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:44.799762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae8cf-642b-468a-a1bb-18a0e37c7878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:44.799762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ae8cf-642b-468a-a1bb-18a0e37c7878 admin admin] PATH_INFO: `/v3/projects/d1fd294bec374baf9912d9a729a0881e/users/c1485176f5834b30945f5f482b73ed1e/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:44.813251 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ae8cf-642b-468a-a1bb-18a0e37c7878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1fd294bec374baf9912d9a729a0881e, user_id=c1485176f5834b30945f5f482b73ed1e, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:44.815921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ae8cf-642b-468a-a1bb-18a0e37c7878 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:44.898826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1117/2230] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:44 2022] PUT /identity/v3/projects/d1fd294bec374baf9912d9a729a0881e/users/c1485176f5834b30945f5f482b73ed1e/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:44.909396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285709-e457-46aa-85e4-13616bf82be7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:44.914450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285709-e457-46aa-85e4-13616bf82be7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:44.914450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285709-e457-46aa-85e4-13616bf82be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:44.939634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-53285709-e457-46aa-85e4-13616bf82be7 None None] MFA Rules not processed for user `c1485176f5834b30945f5f482b73ed1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:44.941039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-53285709-e457-46aa-85e4-13616bf82be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:45.007952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1114/2231] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:45.012558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ae8cf-642b-468a-a1bb-18a0e37c7878 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:45.037145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:45.082245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ae8cf-642b-468a-a1bb-18a0e37c7878 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:45.086949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7958b-1d9e-47db-823f-3615b82b69a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:45.087613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7958b-1d9e-47db-823f-3615b82b69a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:45.087926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7958b-1d9e-47db-823f-3615b82b69a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:45.088197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7958b-1d9e-47db-823f-3615b82b69a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:45.088907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7958b-1d9e-47db-823f-3615b82b69a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:45.090834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7958b-1d9e-47db-823f-3615b82b69a5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:45.266664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1118/2232] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:45 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:45.272754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285709-e457-46aa-85e4-13616bf82be7 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:45.283946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285709-e457-46aa-85e4-13616bf82be7 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:45.293363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:45.343183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4b6bd-29c8-4463-a435-59fb9a751cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:45.343854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4b6bd-29c8-4463-a435-59fb9a751cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:45.344169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4b6bd-29c8-4463-a435-59fb9a751cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:45.344616 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4b6bd-29c8-4463-a435-59fb9a751cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:45.345320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4b6bd-29c8-4463-a435-59fb9a751cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:45.347245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4b6bd-29c8-4463-a435-59fb9a751cf4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:45.480912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1115/2233] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:45 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:45.485363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7958b-1d9e-47db-823f-3615b82b69a5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:45.495622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7958b-1d9e-47db-823f-3615b82b69a5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:45.500836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f190ad3-07c0-4331-895e-50bd64cbb01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:45.501511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f190ad3-07c0-4331-895e-50bd64cbb01f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:45.501827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f190ad3-07c0-4331-895e-50bd64cbb01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:45.502135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f190ad3-07c0-4331-895e-50bd64cbb01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:45.503982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f190ad3-07c0-4331-895e-50bd64cbb01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:45.508682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f190ad3-07c0-4331-895e-50bd64cbb01f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:45.521312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1119/2234] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:45.525734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4b6bd-29c8-4463-a435-59fb9a751cf4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:45.536937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4b6bd-29c8-4463-a435-59fb9a751cf4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:45.545639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7b4fe-6c57-4b13-a3f9-7309ad0d607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:45.545639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b4fe-6c57-4b13-a3f9-7309ad0d607c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:45.545639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b4fe-6c57-4b13-a3f9-7309ad0d607c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:45.545639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b4fe-6c57-4b13-a3f9-7309ad0d607c admin admin] PATH_INFO: `/v3/projects/1b68d259b5af404ca483303d3b81a6b1/users/65d644ee6b8247daa051ac56d82107ec/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:45.560163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7b4fe-6c57-4b13-a3f9-7309ad0d607c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b68d259b5af404ca483303d3b81a6b1, user_id=65d644ee6b8247daa051ac56d82107ec, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:45.563157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7b4fe-6c57-4b13-a3f9-7309ad0d607c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:45.675513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1116/2235] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:45 2022] PUT /identity/v3/projects/1b68d259b5af404ca483303d3b81a6b1/users/65d644ee6b8247daa051ac56d82107ec/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:45.679488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f190ad3-07c0-4331-895e-50bd64cbb01f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:45.690205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f190ad3-07c0-4331-895e-50bd64cbb01f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:45.746108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ae352-63a8-4809-94d2-25d2d837d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:45.746743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ae352-63a8-4809-94d2-25d2d837d575 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:45.746961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ae352-63a8-4809-94d2-25d2d837d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:45.747237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ae352-63a8-4809-94d2-25d2d837d575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:45.748742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ae352-63a8-4809-94d2-25d2d837d575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:45.750349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ae352-63a8-4809-94d2-25d2d837d575 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:45.763227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1120/2236] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:45.765042 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7b4fe-6c57-4b13-a3f9-7309ad0d607c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:45.775197 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7b4fe-6c57-4b13-a3f9-7309ad0d607c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:45.779985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76351c-eeda-440c-8fbe-5f99e32f323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:45.780858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76351c-eeda-440c-8fbe-5f99e32f323f admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:45.781139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76351c-eeda-440c-8fbe-5f99e32f323f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:45.781413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76351c-eeda-440c-8fbe-5f99e32f323f admin admin] PATH_INFO: `/v3/projects/1b68d259b5af404ca483303d3b81a6b1/users/65d644ee6b8247daa051ac56d82107ec/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:45.783357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76351c-eeda-440c-8fbe-5f99e32f323f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b68d259b5af404ca483303d3b81a6b1, user_id=65d644ee6b8247daa051ac56d82107ec, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:45.786017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76351c-eeda-440c-8fbe-5f99e32f323f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:45.801064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1117/2237] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:45 2022] PUT /identity/v3/projects/1b68d259b5af404ca483303d3b81a6b1/users/65d644ee6b8247daa051ac56d82107ec/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:45.814456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8e675-486d-4b55-a888-b5fd543b4fb8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:45.814748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8e675-486d-4b55-a888-b5fd543b4fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:45.815034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8e675-486d-4b55-a888-b5fd543b4fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:45.841807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-12e8e675-486d-4b55-a888-b5fd543b4fb8 None None] MFA Rules not processed for user `65d644ee6b8247daa051ac56d82107ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:45.843046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-12e8e675-486d-4b55-a888-b5fd543b4fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:45.910992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1121/2238] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:45.922486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76351c-eeda-440c-8fbe-5f99e32f323f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:45.924190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ba76351c-eeda-440c-8fbe-5f99e32f323f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:45.981602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76351c-eeda-440c-8fbe-5f99e32f323f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:45.985551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:45.986723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:45.986723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:45.986723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:45.988612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:46.048635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:46.050034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:46.058862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1118/2239] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:46.114985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:46.286929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:46.468961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:46.787966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:49.120794 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8e675-486d-4b55-a888-b5fd543b4fb8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:49.131505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8e675-486d-4b55-a888-b5fd543b4fb8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:49.135343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d77a44-b817-41e8-89ed-712584d33638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:49.136029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d77a44-b817-41e8-89ed-712584d33638 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:49.136342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d77a44-b817-41e8-89ed-712584d33638 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:49.136620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d77a44-b817-41e8-89ed-712584d33638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:49.197761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d77a44-b817-41e8-89ed-712584d33638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:49.199203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d77a44-b817-41e8-89ed-712584d33638 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:49.212232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1122/2240] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:51.083203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:51.084845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:51.096176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150342a-ccd1-47d6-82a1-4e30406c14da service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:51.099892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b964f6f-0053-4354-8f18-9cee03de5e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:51.100604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b964f6f-0053-4354-8f18-9cee03de5e88 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:51.100887 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b964f6f-0053-4354-8f18-9cee03de5e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:51.101163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b964f6f-0053-4354-8f18-9cee03de5e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:51.110818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b964f6f-0053-4354-8f18-9cee03de5e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:51.112396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b964f6f-0053-4354-8f18-9cee03de5e88 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:51.121662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1119/2241] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:51.333900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d77a44-b817-41e8-89ed-712584d33638 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:51.343115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d77a44-b817-41e8-89ed-712584d33638 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:51.346799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2239ec8-3770-4b70-ae73-78a036d35f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:51.347444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239ec8-3770-4b70-ae73-78a036d35f52 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:51.348008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239ec8-3770-4b70-ae73-78a036d35f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:51.348296 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2239ec8-3770-4b70-ae73-78a036d35f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:51.350325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d2239ec8-3770-4b70-ae73-78a036d35f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:51.387780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:51.422669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2239ec8-3770-4b70-ae73-78a036d35f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:51.424119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2239ec8-3770-4b70-ae73-78a036d35f52 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:51.433719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1123/2242] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:52.923047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b964f6f-0053-4354-8f18-9cee03de5e88 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:52.924701 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7b964f6f-0053-4354-8f18-9cee03de5e88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:52.996149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b964f6f-0053-4354-8f18-9cee03de5e88 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:53.001699 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:53.002567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:53.002854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:53.003127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] PATH_INFO: `/v3/users/5ba7948690ab4bc5a09a66de44a85b5f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:53.004446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba7948690ab4bc5a09a66de44a85b5f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:53.006406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:53.011733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:53.230787 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba7948690ab4bc5a09a66de44a85b5f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:53.238260 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba7948690ab4bc5a09a66de44a85b5f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:53.303053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba7948690ab4bc5a09a66de44a85b5f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:53.306788 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba7948690ab4bc5a09a66de44a85b5f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:53.316869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba7948690ab4bc5a09a66de44a85b5f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:53.323079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1120/2243] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:52 2022] DELETE /identity/v3/users/5ba7948690ab4bc5a09a66de44a85b5f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:53.327909 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7111ade-6484-419f-bb77-bc61f7c85f54 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:53.328405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7111ade-6484-419f-bb77-bc61f7c85f54 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:53.328497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7111ade-6484-419f-bb77-bc61f7c85f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:53.345710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d7111ade-6484-419f-bb77-bc61f7c85f54 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:53.346917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d7111ade-6484-419f-bb77-bc61f7c85f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:53.404622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1124/2244] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:53.414767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:53.416175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:53.473749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e5799-3ff3-45e2-b545-ff0b4ee25a32 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:53.477361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c07fc0-2b35-45e4-8565-cd03f6e7f607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:53.478005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c07fc0-2b35-45e4-8565-cd03f6e7f607 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:53.478295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c07fc0-2b35-45e4-8565-cd03f6e7f607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:53.478590 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c07fc0-2b35-45e4-8565-cd03f6e7f607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:53.488265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c07fc0-2b35-45e4-8565-cd03f6e7f607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:53.489706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c07fc0-2b35-45e4-8565-cd03f6e7f607 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:53.499289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1121/2245] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:53.915244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7111ade-6484-419f-bb77-bc61f7c85f54 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:53.916668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d7111ade-6484-419f-bb77-bc61f7c85f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:53.928779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7111ade-6484-419f-bb77-bc61f7c85f54 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:53.933772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:53.934970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:53.935470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:53.936213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] PATH_INFO: `/v3/projects/2b49dcebebed4af58712d5e1394337a0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:53.937622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b49dcebebed4af58712d5e1394337a0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:53.939771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:54.080998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b49dcebebed4af58712d5e1394337a0', 'request_id': 'req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:54.160280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b49dcebebed4af58712d5e1394337a0', 'request_id': 'req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:54.167133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b49dcebebed4af58712d5e1394337a0', 'request_id': 'req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:54.177559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] The token cache is being invalidate because project 2b49dcebebed4af58712d5e1394337a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:54.177886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:54.179848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3742832-fe3a-4cc2-8ca8-91f81dfb183b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:54.180196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1125/2246] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:53 2022] DELETE /identity/v3/projects/2b49dcebebed4af58712d5e1394337a0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:54.185068 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2719c-5cd5-4477-8ad8-9b01819db83f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:54.185513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2719c-5cd5-4477-8ad8-9b01819db83f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:54.185931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2719c-5cd5-4477-8ad8-9b01819db83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:54.204987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4fb2719c-5cd5-4477-8ad8-9b01819db83f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:54.206262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4fb2719c-5cd5-4477-8ad8-9b01819db83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:54.266954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1122/2247] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:54.274898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fbf9f-89dd-4b8c-a079-43224ff416fd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:54.275191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fbf9f-89dd-4b8c-a079-43224ff416fd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:54.275466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fbf9f-89dd-4b8c-a079-43224ff416fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:54.293889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e34fbf9f-89dd-4b8c-a079-43224ff416fd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:54.295107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e34fbf9f-89dd-4b8c-a079-43224ff416fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:54.303197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1126/2248] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:54.307423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2719c-5cd5-4477-8ad8-9b01819db83f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:54.317886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2719c-5cd5-4477-8ad8-9b01819db83f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:54.322798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14ea89-45c1-484c-b63e-9fbab37042ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:54.323459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14ea89-45c1-484c-b63e-9fbab37042ad admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:54.323738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14ea89-45c1-484c-b63e-9fbab37042ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:54.324041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14ea89-45c1-484c-b63e-9fbab37042ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:54.324762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14ea89-45c1-484c-b63e-9fbab37042ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:15:54.325069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14ea89-45c1-484c-b63e-9fbab37042ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:54.327393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14ea89-45c1-484c-b63e-9fbab37042ad admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:54.339190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1123/2249] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:15:54.344023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fbf9f-89dd-4b8c-a079-43224ff416fd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:54.353366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fbf9f-89dd-4b8c-a079-43224ff416fd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:54.358339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fd74-efa8-4be1-85c4-66e388731694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:54.358996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fd74-efa8-4be1-85c4-66e388731694 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:54.359284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fd74-efa8-4be1-85c4-66e388731694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:54.359565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fd74-efa8-4be1-85c4-66e388731694 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:54.360345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8fd74-efa8-4be1-85c4-66e388731694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:54.362252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8fd74-efa8-4be1-85c4-66e388731694 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:54.453575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1127/2250] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:15:54 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:54.457625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14ea89-45c1-484c-b63e-9fbab37042ad admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:54.467432 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14ea89-45c1-484c-b63e-9fbab37042ad admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:54.478461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:54.524931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364421e0-0437-46b5-8fd8-ca71c436779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:54.525896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364421e0-0437-46b5-8fd8-ca71c436779f admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:54.526317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364421e0-0437-46b5-8fd8-ca71c436779f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:54.526758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364421e0-0437-46b5-8fd8-ca71c436779f admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:54.527825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364421e0-0437-46b5-8fd8-ca71c436779f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:54.531413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364421e0-0437-46b5-8fd8-ca71c436779f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:54.633366 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1124/2251] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:15:54 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:15:54.637510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fd74-efa8-4be1-85c4-66e388731694 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:54.648166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fd74-efa8-4be1-85c4-66e388731694 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:54.652871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f710772-27e0-4f71-bfe2-6e7d97259a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:54.653535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710772-27e0-4f71-bfe2-6e7d97259a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:54.653820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710772-27e0-4f71-bfe2-6e7d97259a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:54.654096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710772-27e0-4f71-bfe2-6e7d97259a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:54.659981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f710772-27e0-4f71-bfe2-6e7d97259a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:54.659981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f710772-27e0-4f71-bfe2-6e7d97259a91 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:54.667126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1128/2252] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:15:54.671950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364421e0-0437-46b5-8fd8-ca71c436779f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:54.682300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364421e0-0437-46b5-8fd8-ca71c436779f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:54.687930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c748ac4-b6ee-4f5a-a488-4bab4fb0043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:54.688594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c748ac4-b6ee-4f5a-a488-4bab4fb0043a admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:54.688879 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c748ac4-b6ee-4f5a-a488-4bab4fb0043a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:54.689152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c748ac4-b6ee-4f5a-a488-4bab4fb0043a admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:54.689887 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c748ac4-b6ee-4f5a-a488-4bab4fb0043a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:54.692059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c748ac4-b6ee-4f5a-a488-4bab4fb0043a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:54.704690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1125/2253] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:15:54.705872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f710772-27e0-4f71-bfe2-6e7d97259a91 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:54.715820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f710772-27e0-4f71-bfe2-6e7d97259a91 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:54.720461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e78c0-1120-4131-a5fc-f05614869e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:54.721366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e78c0-1120-4131-a5fc-f05614869e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:54.721650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e78c0-1120-4131-a5fc-f05614869e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:54.721929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e78c0-1120-4131-a5fc-f05614869e10 admin admin] PATH_INFO: `/v3/projects/8f1fffe8e0b64e09a5fef45daf03ed8a/users/5b92444a65ce4ebcb8d22145edc1ec72/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:54.725512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:54.737674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e78c0-1120-4131-a5fc-f05614869e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1fffe8e0b64e09a5fef45daf03ed8a, user_id=5b92444a65ce4ebcb8d22145edc1ec72, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:54.740472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e78c0-1120-4131-a5fc-f05614869e10 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:54.841042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1129/2254] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:15:54 2022] PUT /identity/v3/projects/8f1fffe8e0b64e09a5fef45daf03ed8a/users/5b92444a65ce4ebcb8d22145edc1ec72/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:54.852148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c686a-f580-488a-921f-52d126afed5d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:54.852437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c686a-f580-488a-921f-52d126afed5d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:54.852717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c686a-f580-488a-921f-52d126afed5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:54.879958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-292c686a-f580-488a-921f-52d126afed5d None None] MFA Rules not processed for user `5b92444a65ce4ebcb8d22145edc1ec72`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:54.881238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-292c686a-f580-488a-921f-52d126afed5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:54.953445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1126/2255] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:15:54.964684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e78c0-1120-4131-a5fc-f05614869e10 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:54.967862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-033e78c0-1120-4131-a5fc-f05614869e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:55.027629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e78c0-1120-4131-a5fc-f05614869e10 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:55.032158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf0240-82aa-4c34-b837-4b8941ea66c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:55.032910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0240-82aa-4c34-b837-4b8941ea66c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:55.033227 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0240-82aa-4c34-b837-4b8941ea66c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:55.033626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf0240-82aa-4c34-b837-4b8941ea66c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:55.042221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf0240-82aa-4c34-b837-4b8941ea66c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:55.043684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf0240-82aa-4c34-b837-4b8941ea66c6 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:55.053459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1130/2256] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:15:57.455232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c686a-f580-488a-921f-52d126afed5d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:57.457514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-292c686a-f580-488a-921f-52d126afed5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:57.534422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c686a-f580-488a-921f-52d126afed5d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:57.539056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:57.540008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:57.540295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:57.540569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] PATH_INFO: `/v3/users/41151be95e704592b4a375444409d852` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:57.541774 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41151be95e704592b4a375444409d852)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:57.543720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:57.658879 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:57.734159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41151be95e704592b4a375444409d852'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:57.741351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41151be95e704592b4a375444409d852'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:57.812221 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41151be95e704592b4a375444409d852'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:57.813623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41151be95e704592b4a375444409d852'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:57.829529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41151be95e704592b4a375444409d852'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:57.840194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1127/2257] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:57 2022] DELETE /identity/v3/users/41151be95e704592b4a375444409d852 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:57.841878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d689a2f-2551-4de3-b1fe-cec0cebcd782 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:57.842608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d689a2f-2551-4de3-b1fe-cec0cebcd782 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:57.842608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d689a2f-2551-4de3-b1fe-cec0cebcd782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:57.861788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5d689a2f-2551-4de3-b1fe-cec0cebcd782 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:57.862993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d689a2f-2551-4de3-b1fe-cec0cebcd782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:57.921059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1131/2258] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:57.930910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:57.932417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:58.004995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcb90a-8912-4f55-b13f-3796a85e4d29 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:58.008741 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec39df-629c-4ab4-8aad-9c7535aa9de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:58.009519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec39df-629c-4ab4-8aad-9c7535aa9de2 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:58.009657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec39df-629c-4ab4-8aad-9c7535aa9de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:58.009931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec39df-629c-4ab4-8aad-9c7535aa9de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:58.019829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec39df-629c-4ab4-8aad-9c7535aa9de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:58.021293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec39df-629c-4ab4-8aad-9c7535aa9de2 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:58.031037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1128/2259] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:15:58.425258 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d689a2f-2551-4de3-b1fe-cec0cebcd782 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:58.426755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d689a2f-2551-4de3-b1fe-cec0cebcd782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:58.454058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d689a2f-2551-4de3-b1fe-cec0cebcd782 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:58.458304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:58.459167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:58.459451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:58.459911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] PATH_INFO: `/v3/projects/4b92480a377940ddb4a4a81fd52b271e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:58.461138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b92480a377940ddb4a4a81fd52b271e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:58.463041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:58.562094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b92480a377940ddb4a4a81fd52b271e', 'request_id': 'req-3f36e832-9616-4145-bbe5-5fbc81b855f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:58.634304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b92480a377940ddb4a4a81fd52b271e', 'request_id': 'req-3f36e832-9616-4145-bbe5-5fbc81b855f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:58.641674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b92480a377940ddb4a4a81fd52b271e', 'request_id': 'req-3f36e832-9616-4145-bbe5-5fbc81b855f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:58.652209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] The token cache is being invalidate because project 4b92480a377940ddb4a4a81fd52b271e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:58.652498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:58.653127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:58.654679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1132/2260] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:58 2022] DELETE /identity/v3/projects/4b92480a377940ddb4a4a81fd52b271e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:58.659081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec39df-629c-4ab4-8aad-9c7535aa9de2 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:58.668516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec39df-629c-4ab4-8aad-9c7535aa9de2 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:58.724758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:58.725622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:58.725904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:58.726177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] PATH_INFO: `/v3/users/c1485176f5834b30945f5f482b73ed1e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:58.727358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1485176f5834b30945f5f482b73ed1e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:58.729309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:59.002869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1485176f5834b30945f5f482b73ed1e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.004116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:59.010573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1485176f5834b30945f5f482b73ed1e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.120036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1485176f5834b30945f5f482b73ed1e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.120655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1485176f5834b30945f5f482b73ed1e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.132742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1485176f5834b30945f5f482b73ed1e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.138596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1129/2261] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:58 2022] DELETE /identity/v3/users/c1485176f5834b30945f5f482b73ed1e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:59.361681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:59.363310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:59.375735 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36e832-9616-4145-bbe5-5fbc81b855f1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:59.392892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:59.443043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:59.443963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:59.444255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:59.444538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] PATH_INFO: `/v3/users/5b92444a65ce4ebcb8d22145edc1ec72` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:59.446043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b92444a65ce4ebcb8d22145edc1ec72)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:59.448574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:59.568247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:59.569679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:59.584001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefa2d9-5311-476a-af03-37a5bfef820e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:59.588839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:59.589709 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:59.589986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:59.590252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] PATH_INFO: `/v3/projects/d1fd294bec374baf9912d9a729a0881e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:59.591742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1fd294bec374baf9912d9a729a0881e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:59.594682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:59.654590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b92444a65ce4ebcb8d22145edc1ec72'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.662321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b92444a65ce4ebcb8d22145edc1ec72'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.663090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b92444a65ce4ebcb8d22145edc1ec72'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.676563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b92444a65ce4ebcb8d22145edc1ec72'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.703250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1fd294bec374baf9912d9a729a0881e', 'request_id': 'req-789c0912-0feb-42dc-89bc-7a52c4599614'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.710317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1fd294bec374baf9912d9a729a0881e', 'request_id': 'req-789c0912-0feb-42dc-89bc-7a52c4599614'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.716198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1fd294bec374baf9912d9a729a0881e', 'request_id': 'req-789c0912-0feb-42dc-89bc-7a52c4599614'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.753410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc403db-7209-41f8-8368-d281c8b75e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b92444a65ce4ebcb8d22145edc1ec72'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.760094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1133/2262] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:59 2022] DELETE /identity/v3/users/5b92444a65ce4ebcb8d22145edc1ec72 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:15:59.765416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed38e6-e82d-4560-bd4a-2e88775ff855 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:59.765708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed38e6-e82d-4560-bd4a-2e88775ff855 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:59.765991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed38e6-e82d-4560-bd4a-2e88775ff855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:59.784483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7bed38e6-e82d-4560-bd4a-2e88775ff855 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:15:59.785838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7bed38e6-e82d-4560-bd4a-2e88775ff855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:59.827044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] The token cache is being invalidate because project d1fd294bec374baf9912d9a729a0881e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:15:59.827451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.828104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:15:59.829687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1130/2263] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:15:59 2022] DELETE /identity/v3/projects/d1fd294bec374baf9912d9a729a0881e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:15:59.833842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:59.835388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:59.845594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1134/2264] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:15:59.855720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed38e6-e82d-4560-bd4a-2e88775ff855 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:15:59.857093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7bed38e6-e82d-4560-bd4a-2e88775ff855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:15:59.893565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:15:59.902410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c0912-0feb-42dc-89bc-7a52c4599614 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:59.907414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:59.908263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:59.909257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:59.909522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] PATH_INFO: `/v3/users/65d644ee6b8247daa051ac56d82107ec` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:59.910775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d644ee6b8247daa051ac56d82107ec)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:59.912817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:59.920086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed38e6-e82d-4560-bd4a-2e88775ff855 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:15:59.924160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2ab54-3688-4cab-965b-0a4d8b8df763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:15:59.924882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2ab54-3688-4cab-965b-0a4d8b8df763 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:15:59.925296 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2ab54-3688-4cab-965b-0a4d8b8df763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:15:59.933663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2ab54-3688-4cab-965b-0a4d8b8df763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:15:59.945998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2ab54-3688-4cab-965b-0a4d8b8df763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:15:59.947637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2ab54-3688-4cab-965b-0a4d8b8df763 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:15:59.959921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1135/2265] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:16:00.189061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d644ee6b8247daa051ac56d82107ec'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.192565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:00.198607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d644ee6b8247daa051ac56d82107ec'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.320021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d644ee6b8247daa051ac56d82107ec'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.320752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d644ee6b8247daa051ac56d82107ec'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.333799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-4eff55fa-6031-4e0b-813d-fa591ed9332e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d644ee6b8247daa051ac56d82107ec'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.340202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1131/2266] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:15:59 2022] DELETE /identity/v3/users/65d644ee6b8247daa051ac56d82107ec => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:16:00.402487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2ab54-3688-4cab-965b-0a4d8b8df763 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:00.403952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41d2ab54-3688-4cab-965b-0a4d8b8df763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:00.417584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2ab54-3688-4cab-965b-0a4d8b8df763 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:00.479374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:00.480283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:00.480572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:00.485316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] PATH_INFO: `/v3/projects/8f1fffe8e0b64e09a5fef45daf03ed8a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:00.485316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1fffe8e0b64e09a5fef45daf03ed8a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:00.485316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:00.675572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1fffe8e0b64e09a5fef45daf03ed8a', 'request_id': 'req-b42fc5fd-fed5-4443-9fe5-082143f3ea77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.788781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1fffe8e0b64e09a5fef45daf03ed8a', 'request_id': 'req-b42fc5fd-fed5-4443-9fe5-082143f3ea77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.796284 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1fffe8e0b64e09a5fef45daf03ed8a', 'request_id': 'req-b42fc5fd-fed5-4443-9fe5-082143f3ea77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.808031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] The token cache is being invalidate because project 8f1fffe8e0b64e09a5fef45daf03ed8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:16:00.808323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.809000 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:00.810838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1136/2267] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:16:00 2022] DELETE /identity/v3/projects/8f1fffe8e0b64e09a5fef45daf03ed8a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:00.816397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd315c-0211-428f-be87-084e6ee5c2e5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:00.816864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd315c-0211-428f-be87-084e6ee5c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:00.816970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd315c-0211-428f-be87-084e6ee5c2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:00.836605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-cfdd315c-0211-428f-be87-084e6ee5c2e5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:00.837828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cfdd315c-0211-428f-be87-084e6ee5c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:00.863249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:00.868005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:00.919773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1132/2268] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:00.929634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb1057-62d9-424f-9978-c9d3a60130bd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:00.930255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb1057-62d9-424f-9978-c9d3a60130bd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:00.933298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb1057-62d9-424f-9978-c9d3a60130bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:00.952557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1fbb1057-62d9-424f-9978-c9d3a60130bd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:00.956785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1fbb1057-62d9-424f-9978-c9d3a60130bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:00.960363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fc5fd-fed5-4443-9fe5-082143f3ea77 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:00.962458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1133/2269] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:16:00.965232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:00.966185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:00.966471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:00.966749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] PATH_INFO: `/v3/projects/1b68d259b5af404ca483303d3b81a6b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:00.968084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b68d259b5af404ca483303d3b81a6b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:00.968225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb1057-62d9-424f-9978-c9d3a60130bd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:00.969991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:00.977373 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:00.977732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb1057-62d9-424f-9978-c9d3a60130bd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:00.982448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b69c8-0d40-4442-9c46-ce135876eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:00.983091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b69c8-0d40-4442-9c46-ce135876eb37 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:00.983373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b69c8-0d40-4442-9c46-ce135876eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:00.985477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b69c8-0d40-4442-9c46-ce135876eb37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:00.985477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b69c8-0d40-4442-9c46-ce135876eb37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:16:00.985477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b69c8-0d40-4442-9c46-ce135876eb37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:00.986285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b69c8-0d40-4442-9c46-ce135876eb37 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:00.999038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1134/2270] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:16:01.003334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b69c8-0d40-4442-9c46-ce135876eb37 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.012858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b69c8-0d40-4442-9c46-ce135876eb37 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.017908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674c5de-f22a-4664-9dd2-700ac01ed263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.018613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674c5de-f22a-4664-9dd2-700ac01ed263 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.018901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674c5de-f22a-4664-9dd2-700ac01ed263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.019977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674c5de-f22a-4664-9dd2-700ac01ed263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.019977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674c5de-f22a-4664-9dd2-700ac01ed263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.021780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674c5de-f22a-4664-9dd2-700ac01ed263 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.124233 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b68d259b5af404ca483303d3b81a6b1', 'request_id': 'req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:01.162652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1135/2271] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:16:01 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:16:01.166581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674c5de-f22a-4664-9dd2-700ac01ed263 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.183268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b68d259b5af404ca483303d3b81a6b1', 'request_id': 'req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:01.190956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b68d259b5af404ca483303d3b81a6b1', 'request_id': 'req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:01.202591 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] The token cache is being invalidate because project 1b68d259b5af404ca483303d3b81a6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:16:01.202882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:01.203548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc05ee26-13ae-4e19-b3fc-a773e8a4138f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:01.205336 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1137/2272] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:16:00 2022] DELETE /identity/v3/projects/1b68d259b5af404ca483303d3b81a6b1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:01.210438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a48aa1-c66c-497d-8ad6-cd924bb87bff None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.210721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a48aa1-c66c-497d-8ad6-cd924bb87bff None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.211032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a48aa1-c66c-497d-8ad6-cd924bb87bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.230815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674c5de-f22a-4664-9dd2-700ac01ed263 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.230950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-95a48aa1-c66c-497d-8ad6-cd924bb87bff None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:01.232253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-95a48aa1-c66c-497d-8ad6-cd924bb87bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:01.236252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a4224-381c-4a41-89c9-b4f47dc7a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.237467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a4224-381c-4a41-89c9-b4f47dc7a522 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.237796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a4224-381c-4a41-89c9-b4f47dc7a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.238074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a4224-381c-4a41-89c9-b4f47dc7a522 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.238772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a4224-381c-4a41-89c9-b4f47dc7a522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.240923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a4224-381c-4a41-89c9-b4f47dc7a522 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.242155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1138/2273] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:16:01.249807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a518552-c1ad-4da5-9d98-a2847dfff54d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.250183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a518552-c1ad-4da5-9d98-a2847dfff54d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.250458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a518552-c1ad-4da5-9d98-a2847dfff54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.268627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1a518552-c1ad-4da5-9d98-a2847dfff54d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:01.269818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a518552-c1ad-4da5-9d98-a2847dfff54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:01.277636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1139/2274] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:16:01.281755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a518552-c1ad-4da5-9d98-a2847dfff54d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.290621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a518552-c1ad-4da5-9d98-a2847dfff54d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.295216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6c62f-1a7e-4a7b-badf-7daca4ed4c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.295840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6c62f-1a7e-4a7b-badf-7daca4ed4c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.296151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6c62f-1a7e-4a7b-badf-7daca4ed4c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.296444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6c62f-1a7e-4a7b-badf-7daca4ed4c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.297141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6c62f-1a7e-4a7b-badf-7daca4ed4c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:16:01.297445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6c62f-1a7e-4a7b-badf-7daca4ed4c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.299010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6c62f-1a7e-4a7b-badf-7daca4ed4c4c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.311447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1140/2275] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:16:01.313890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1136/2276] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:16:01 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:16:01.316150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6c62f-1a7e-4a7b-badf-7daca4ed4c4c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.318845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a4224-381c-4a41-89c9-b4f47dc7a522 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.320490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-615a4224-381c-4a41-89c9-b4f47dc7a522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:01.326155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6c62f-1a7e-4a7b-badf-7daca4ed4c4c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.331573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58416896-fa56-4a4e-a28d-e6ecd86dfed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.332271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58416896-fa56-4a4e-a28d-e6ecd86dfed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.332557 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58416896-fa56-4a4e-a28d-e6ecd86dfed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.332916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58416896-fa56-4a4e-a28d-e6ecd86dfed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.333656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58416896-fa56-4a4e-a28d-e6ecd86dfed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.334275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a4224-381c-4a41-89c9-b4f47dc7a522 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.335611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58416896-fa56-4a4e-a28d-e6ecd86dfed3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.339086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f9f62-0688-4fba-8184-ef43b03ae622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.339743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9f62-0688-4fba-8184-ef43b03ae622 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.340065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9f62-0688-4fba-8184-ef43b03ae622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.340500 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f9f62-0688-4fba-8184-ef43b03ae622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.341229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f9f62-0688-4fba-8184-ef43b03ae622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.342872 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f9f62-0688-4fba-8184-ef43b03ae622 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.353231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1137/2277] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:16:01.357275 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f9f62-0688-4fba-8184-ef43b03ae622 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.367606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f9f62-0688-4fba-8184-ef43b03ae622 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.372287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d74cd-2cd7-4697-bcc5-5b551b16f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.372929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d74cd-2cd7-4697-bcc5-5b551b16f923 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.373207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d74cd-2cd7-4697-bcc5-5b551b16f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.373480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d74cd-2cd7-4697-bcc5-5b551b16f923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.374194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d74cd-2cd7-4697-bcc5-5b551b16f923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.375800 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d74cd-2cd7-4697-bcc5-5b551b16f923 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.378970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:01.388662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1138/2278] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:16:01.392548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d74cd-2cd7-4697-bcc5-5b551b16f923 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.401989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d74cd-2cd7-4697-bcc5-5b551b16f923 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.406858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8b351-c550-4ac4-b262-a49881a58afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.407727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b351-c550-4ac4-b262-a49881a58afc admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.408053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b351-c550-4ac4-b262-a49881a58afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.408355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b351-c550-4ac4-b262-a49881a58afc admin admin] PATH_INFO: `/v3/projects/5f0d9be370144da1a2a39010702c0c6e/users/0eb14f2ee3d849f4a42e42fe175ddeb6/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.425061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8b351-c550-4ac4-b262-a49881a58afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0d9be370144da1a2a39010702c0c6e, user_id=0eb14f2ee3d849f4a42e42fe175ddeb6, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.427782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8b351-c550-4ac4-b262-a49881a58afc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.436063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1141/2279] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:16:01 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:16:01.440157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58416896-fa56-4a4e-a28d-e6ecd86dfed3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.503751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58416896-fa56-4a4e-a28d-e6ecd86dfed3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.508596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e1477-bd5b-419a-95e0-3d49d121f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.509267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e1477-bd5b-419a-95e0-3d49d121f97e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.509652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e1477-bd5b-419a-95e0-3d49d121f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.515652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e1477-bd5b-419a-95e0-3d49d121f97e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.515652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e1477-bd5b-419a-95e0-3d49d121f97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.515652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e1477-bd5b-419a-95e0-3d49d121f97e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.542029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1139/2280] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:01 2022] PUT /identity/v3/projects/5f0d9be370144da1a2a39010702c0c6e/users/0eb14f2ee3d849f4a42e42fe175ddeb6/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:16:01.552570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71aa480-4180-405c-85d6-336979df471f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.552861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71aa480-4180-405c-85d6-336979df471f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.553144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71aa480-4180-405c-85d6-336979df471f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.579283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e71aa480-4180-405c-85d6-336979df471f None None] MFA Rules not processed for user `0eb14f2ee3d849f4a42e42fe175ddeb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:01.580457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e71aa480-4180-405c-85d6-336979df471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:01.615912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1142/2281] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:16:01 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:16:01.616994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e1477-bd5b-419a-95e0-3d49d121f97e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.626634 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e1477-bd5b-419a-95e0-3d49d121f97e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.653297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1140/2282] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:16:01.666186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71aa480-4180-405c-85d6-336979df471f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.667553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e71aa480-4180-405c-85d6-336979df471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:01.690758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d630ed0-d16b-4615-a0da-b9e45386a5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.691372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d630ed0-d16b-4615-a0da-b9e45386a5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.691663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d630ed0-d16b-4615-a0da-b9e45386a5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.691974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d630ed0-d16b-4615-a0da-b9e45386a5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.692722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d630ed0-d16b-4615-a0da-b9e45386a5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.694342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d630ed0-d16b-4615-a0da-b9e45386a5b2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.707956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1143/2283] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:16:01.712081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d630ed0-d16b-4615-a0da-b9e45386a5b2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.730482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d630ed0-d16b-4615-a0da-b9e45386a5b2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.734111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71aa480-4180-405c-85d6-336979df471f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.735679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e22c6-0393-4831-90ea-f90f7817f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.736396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e22c6-0393-4831-90ea-f90f7817f659 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.737275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e22c6-0393-4831-90ea-f90f7817f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.738174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e22c6-0393-4831-90ea-f90f7817f659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.738371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b05926-99ce-46c4-9a13-9551b3b0384e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.738965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e22c6-0393-4831-90ea-f90f7817f659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.739074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b05926-99ce-46c4-9a13-9551b3b0384e service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.739290 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b05926-99ce-46c4-9a13-9551b3b0384e service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.739567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b05926-99ce-46c4-9a13-9551b3b0384e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.740844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e22c6-0393-4831-90ea-f90f7817f659 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.749096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b05926-99ce-46c4-9a13-9551b3b0384e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.750530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b05926-99ce-46c4-9a13-9551b3b0384e service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.753488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1144/2284] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:16:01.757372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e22c6-0393-4831-90ea-f90f7817f659 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.759643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1141/2285] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:16:01.767360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e22c6-0393-4831-90ea-f90f7817f659 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:01.773158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b89f1f-f091-436b-a2f7-78cbae060437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:01.774102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b89f1f-f091-436b-a2f7-78cbae060437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.774388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b89f1f-f091-436b-a2f7-78cbae060437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.774665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b89f1f-f091-436b-a2f7-78cbae060437 admin admin] PATH_INFO: `/v3/projects/5cab415784f4416eb683a82847963410/users/52c8ffa0e3b34d0cbb49aabb2c5ca75c/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.790030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b89f1f-f091-436b-a2f7-78cbae060437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cab415784f4416eb683a82847963410, user_id=52c8ffa0e3b34d0cbb49aabb2c5ca75c, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:01.792819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b89f1f-f091-436b-a2f7-78cbae060437 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:01.862509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1145/2286] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:01 2022] PUT /identity/v3/projects/5cab415784f4416eb683a82847963410/users/52c8ffa0e3b34d0cbb49aabb2c5ca75c/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:16:01.867588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15c51d-1152-4fdf-87aa-561335039247 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:01.868067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15c51d-1152-4fdf-87aa-561335039247 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:01.868213 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15c51d-1152-4fdf-87aa-561335039247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:01.885900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-6a15c51d-1152-4fdf-87aa-561335039247 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:01.887096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6a15c51d-1152-4fdf-87aa-561335039247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:01.948679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1142/2287] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:01.959051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b89f1f-f091-436b-a2f7-78cbae060437 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:01.960786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-67b89f1f-f091-436b-a2f7-78cbae060437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:02.043401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b89f1f-f091-436b-a2f7-78cbae060437 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:02.047772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798b3d-5dc3-47f9-b8f8-82e93fecf21a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:02.048452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798b3d-5dc3-47f9-b8f8-82e93fecf21a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:02.048967 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798b3d-5dc3-47f9-b8f8-82e93fecf21a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:02.049803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79798b3d-5dc3-47f9-b8f8-82e93fecf21a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:02.059885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79798b3d-5dc3-47f9-b8f8-82e93fecf21a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:02.062298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79798b3d-5dc3-47f9-b8f8-82e93fecf21a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:02.073362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1146/2288] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:16:02.404977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:03.361436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8331f4-f1d0-4eac-b961-d3b26c7cd1e6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:03.361988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8331f4-f1d0-4eac-b961-d3b26c7cd1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:03.362175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8331f4-f1d0-4eac-b961-d3b26c7cd1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:03.368038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:03.389734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5b8331f4-f1d0-4eac-b961-d3b26c7cd1e6 None None] MFA Rules not processed for user `52c8ffa0e3b34d0cbb49aabb2c5ca75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:03.390967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5b8331f4-f1d0-4eac-b961-d3b26c7cd1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:03.457598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1143/2289] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:03.470879 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798b3d-5dc3-47f9-b8f8-82e93fecf21a service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:03.473788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-79798b3d-5dc3-47f9-b8f8-82e93fecf21a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:03.498627 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8331f4-f1d0-4eac-b961-d3b26c7cd1e6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:03.500327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5b8331f4-f1d0-4eac-b961-d3b26c7cd1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:03.515334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8331f4-f1d0-4eac-b961-d3b26c7cd1e6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:03.522069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:03.522900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:03.523187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:03.523468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] PATH_INFO: `/v3/users/af5013cc1e6b4c6083ffe17f25be98ba` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:03.525234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5013cc1e6b4c6083ffe17f25be98ba)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:03.527696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:03.543459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79798b3d-5dc3-47f9-b8f8-82e93fecf21a service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:03.547316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239dfb6-06bf-4e2b-8b04-a950338b9116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:03.547998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239dfb6-06bf-4e2b-8b04-a950338b9116 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:03.548288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239dfb6-06bf-4e2b-8b04-a950338b9116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:03.548565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239dfb6-06bf-4e2b-8b04-a950338b9116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:03.558673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239dfb6-06bf-4e2b-8b04-a950338b9116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:03.560164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239dfb6-06bf-4e2b-8b04-a950338b9116 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:03.574640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1147/2290] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:16:03.733310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5013cc1e6b4c6083ffe17f25be98ba'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:03.740173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5013cc1e6b4c6083ffe17f25be98ba'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:03.851489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5013cc1e6b4c6083ffe17f25be98ba'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:03.852253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5013cc1e6b4c6083ffe17f25be98ba'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:03.864910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5013cc1e6b4c6083ffe17f25be98ba'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:03.870841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1144/2291] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:16:03 2022] DELETE /identity/v3/users/af5013cc1e6b4c6083ffe17f25be98ba => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:16:03.875497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84629-ee17-4d86-b627-af470edbb6a7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:03.875789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84629-ee17-4d86-b627-af470edbb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:03.876108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a84629-ee17-4d86-b627-af470edbb6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:03.894193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-40a84629-ee17-4d86-b627-af470edbb6a7 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:03.895435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-40a84629-ee17-4d86-b627-af470edbb6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:03.956923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1148/2292] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:03.966562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:03.967961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:04.025923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b446fba-8e74-4b1e-aa32-f5797741d3d8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:04.029549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562afbae-cfac-4272-a089-b2601635f2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:04.030195 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562afbae-cfac-4272-a089-b2601635f2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:04.030476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562afbae-cfac-4272-a089-b2601635f2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:04.030753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562afbae-cfac-4272-a089-b2601635f2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:04.039815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562afbae-cfac-4272-a089-b2601635f2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:04.041271 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562afbae-cfac-4272-a089-b2601635f2a4 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:04.051196 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1145/2293] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:16:04.080439 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:04.545999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84629-ee17-4d86-b627-af470edbb6a7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:04.548814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-40a84629-ee17-4d86-b627-af470edbb6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:04.564332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a84629-ee17-4d86-b627-af470edbb6a7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:04.570532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:04.571933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:04.571933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:04.572134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] PATH_INFO: `/v3/projects/696668cc0fd44309b8c63039134d31e0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:04.573467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=696668cc0fd44309b8c63039134d31e0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:04.575440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:04.697946 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696668cc0fd44309b8c63039134d31e0', 'request_id': 'req-01a58730-2d24-42a7-8ed2-61421d367e90'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:04.752572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696668cc0fd44309b8c63039134d31e0', 'request_id': 'req-01a58730-2d24-42a7-8ed2-61421d367e90'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:04.760403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696668cc0fd44309b8c63039134d31e0', 'request_id': 'req-01a58730-2d24-42a7-8ed2-61421d367e90'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:04.773069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] The token cache is being invalidate because project 696668cc0fd44309b8c63039134d31e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:16:04.773503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:04.774222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-01a58730-2d24-42a7-8ed2-61421d367e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:04.775859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1149/2294] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:16:04 2022] DELETE /identity/v3/projects/696668cc0fd44309b8c63039134d31e0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:04.781374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ea4ba-b491-4208-abe7-7ed457cafaa4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:04.781790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ea4ba-b491-4208-abe7-7ed457cafaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:04.782292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ea4ba-b491-4208-abe7-7ed457cafaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:04.795121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:04.801854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f06ea4ba-b491-4208-abe7-7ed457cafaa4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:04.803146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f06ea4ba-b491-4208-abe7-7ed457cafaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:04.868647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1146/2295] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:04.876124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23d06-5f94-4a3e-9501-99a4c8282ef4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:04.876416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23d06-5f94-4a3e-9501-99a4c8282ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:04.876698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23d06-5f94-4a3e-9501-99a4c8282ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:04.895937 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ccc23d06-5f94-4a3e-9501-99a4c8282ef4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:04.897139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ccc23d06-5f94-4a3e-9501-99a4c8282ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:04.905214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1150/2296] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:04.910716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ea4ba-b491-4208-abe7-7ed457cafaa4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:04.920626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ea4ba-b491-4208-abe7-7ed457cafaa4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:04.925730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b873-655d-40db-b85f-ece5edefe6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:04.926384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b873-655d-40db-b85f-ece5edefe6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:04.926670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b873-655d-40db-b85f-ece5edefe6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:04.926950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17b873-655d-40db-b85f-ece5edefe6e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:04.927679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17b873-655d-40db-b85f-ece5edefe6e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:16:04.928028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17b873-655d-40db-b85f-ece5edefe6e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:04.929694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17b873-655d-40db-b85f-ece5edefe6e2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:04.944189 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1147/2297] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:16:04.948823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc23d06-5f94-4a3e-9501-99a4c8282ef4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:04.960432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc23d06-5f94-4a3e-9501-99a4c8282ef4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:04.965548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c126d-970c-41d5-92b5-a2c5a28f4ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:04.966248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c126d-970c-41d5-92b5-a2c5a28f4ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:04.966567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c126d-970c-41d5-92b5-a2c5a28f4ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:04.966956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c126d-970c-41d5-92b5-a2c5a28f4ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:04.967690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c126d-970c-41d5-92b5-a2c5a28f4ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:04.969763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c126d-970c-41d5-92b5-a2c5a28f4ea7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:05.101235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1151/2298] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:16:04 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:16:05.102365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b873-655d-40db-b85f-ece5edefe6e2 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:05.112904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17b873-655d-40db-b85f-ece5edefe6e2 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:05.171219 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c993d14-a8e6-49e6-b267-6c13fe2485d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:05.171916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c993d14-a8e6-49e6-b267-6c13fe2485d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:05.172209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c993d14-a8e6-49e6-b267-6c13fe2485d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:05.172487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c993d14-a8e6-49e6-b267-6c13fe2485d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:05.173193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c993d14-a8e6-49e6-b267-6c13fe2485d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:05.175427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c993d14-a8e6-49e6-b267-6c13fe2485d7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:05.241543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1148/2299] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:16:05 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:16:05.245513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c126d-970c-41d5-92b5-a2c5a28f4ea7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:05.257116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c126d-970c-41d5-92b5-a2c5a28f4ea7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:05.261950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505d602-c954-4450-b2bd-2d24087ee864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:05.262786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505d602-c954-4450-b2bd-2d24087ee864 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:05.263071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505d602-c954-4450-b2bd-2d24087ee864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:05.263350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505d602-c954-4450-b2bd-2d24087ee864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:05.264128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505d602-c954-4450-b2bd-2d24087ee864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:05.265732 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505d602-c954-4450-b2bd-2d24087ee864 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:05.276906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1152/2300] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:05.280941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c993d14-a8e6-49e6-b267-6c13fe2485d7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:05.291045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c993d14-a8e6-49e6-b267-6c13fe2485d7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:05.295767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b74324-2883-401f-9c5d-d9e93408df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:05.296454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b74324-2883-401f-9c5d-d9e93408df62 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:05.296738 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b74324-2883-401f-9c5d-d9e93408df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:05.297014 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b74324-2883-401f-9c5d-d9e93408df62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:05.297742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b74324-2883-401f-9c5d-d9e93408df62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:05.299486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b74324-2883-401f-9c5d-d9e93408df62 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:05.309387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1149/2301] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:05.313933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505d602-c954-4450-b2bd-2d24087ee864 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:05.325352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505d602-c954-4450-b2bd-2d24087ee864 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:05.331447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e40d3-fa32-47b9-9941-b67a97fd4325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:05.332412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e40d3-fa32-47b9-9941-b67a97fd4325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:05.332693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e40d3-fa32-47b9-9941-b67a97fd4325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:05.337157 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e40d3-fa32-47b9-9941-b67a97fd4325 admin admin] PATH_INFO: `/v3/projects/2522fe91198f4b77b5b1f3b64c3ea7f3/users/c945b7a697f241c6a01553035d85249b/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:05.349187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e40d3-fa32-47b9-9941-b67a97fd4325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2522fe91198f4b77b5b1f3b64c3ea7f3, user_id=c945b7a697f241c6a01553035d85249b, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:05.352953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e40d3-fa32-47b9-9941-b67a97fd4325 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:05.434698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1153/2302] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:05 2022] PUT /identity/v3/projects/2522fe91198f4b77b5b1f3b64c3ea7f3/users/c945b7a697f241c6a01553035d85249b/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:05.445944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672687-2ee9-4db4-acc5-ffff0b58baf5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:05.446241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672687-2ee9-4db4-acc5-ffff0b58baf5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:05.446548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a672687-2ee9-4db4-acc5-ffff0b58baf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:05.473126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8a672687-2ee9-4db4-acc5-ffff0b58baf5 None None] MFA Rules not processed for user `c945b7a697f241c6a01553035d85249b`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:05.474355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8a672687-2ee9-4db4-acc5-ffff0b58baf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:05.540802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1150/2303] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:05.554106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e40d3-fa32-47b9-9941-b67a97fd4325 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:05.556079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f98e40d3-fa32-47b9-9941-b67a97fd4325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:05.626204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e40d3-fa32-47b9-9941-b67a97fd4325 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:05.630886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce389e0-6af4-479b-a3fb-e9009d2a30f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:05.631573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce389e0-6af4-479b-a3fb-e9009d2a30f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:05.631842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce389e0-6af4-479b-a3fb-e9009d2a30f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:05.632205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce389e0-6af4-479b-a3fb-e9009d2a30f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:05.644281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce389e0-6af4-479b-a3fb-e9009d2a30f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:05.645503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce389e0-6af4-479b-a3fb-e9009d2a30f0 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:05.660197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1154/2304] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:16:06.435801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898aacd-1f8c-45cc-b6d5-83f3b797ee5e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:06.436280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898aacd-1f8c-45cc-b6d5-83f3b797ee5e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:06.436477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898aacd-1f8c-45cc-b6d5-83f3b797ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:06.442842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:06.470187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b898aacd-1f8c-45cc-b6d5-83f3b797ee5e None None] MFA Rules not processed for user `52c8ffa0e3b34d0cbb49aabb2c5ca75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:06.473611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b898aacd-1f8c-45cc-b6d5-83f3b797ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:06.544903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1151/2305] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:08.518634 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d7a6-d3f5-4202-a748-d004a1385a8e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:08.519607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d7a6-d3f5-4202-a748-d004a1385a8e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:08.519724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8d7a6-d3f5-4202-a748-d004a1385a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:08.530352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:08.542057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-87a8d7a6-d3f5-4202-a748-d004a1385a8e None None] MFA Rules not processed for user `c945b7a697f241c6a01553035d85249b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:08.543355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-87a8d7a6-d3f5-4202-a748-d004a1385a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:08.560524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1155/2306] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:16.675799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d23205-6c6d-4fd6-a01e-b8cbb22e03de None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:16.678725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d23205-6c6d-4fd6-a01e-b8cbb22e03de None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:16.678725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d23205-6c6d-4fd6-a01e-b8cbb22e03de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:16.703740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-68d23205-6c6d-4fd6-a01e-b8cbb22e03de None None] MFA Rules not processed for user `cc3cfbaa95774ccbb567374a99e2b25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:16.705025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-68d23205-6c6d-4fd6-a01e-b8cbb22e03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:16.777314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1152/2307] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:18.697456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:22.818046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d7a6-d3f5-4202-a748-d004a1385a8e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:22.819559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-87a8d7a6-d3f5-4202-a748-d004a1385a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:22.957135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8d7a6-d3f5-4202-a748-d004a1385a8e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:22.962505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:22.963390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:22.963673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:22.963985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] PATH_INFO: `/v3/users/7cf79b1dccfa4063b42194bfc3c3a9cb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:22.965211 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf79b1dccfa4063b42194bfc3c3a9cb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:22.967147 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:23.145087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf79b1dccfa4063b42194bfc3c3a9cb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.152304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf79b1dccfa4063b42194bfc3c3a9cb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.152915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf79b1dccfa4063b42194bfc3c3a9cb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.167013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf79b1dccfa4063b42194bfc3c3a9cb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.228001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf79b1dccfa4063b42194bfc3c3a9cb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.234913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1156/2308] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:16:22 2022] DELETE /identity/v3/users/7cf79b1dccfa4063b42194bfc3c3a9cb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:23.493351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d23205-6c6d-4fd6-a01e-b8cbb22e03de None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:23.516573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d23205-6c6d-4fd6-a01e-b8cbb22e03de None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:23.597715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:23.599028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:23.599511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:23.599992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] PATH_INFO: `/v3/projects/4c08962bf6ce45b6b0876859e8bb03d9` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:23.602703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c08962bf6ce45b6b0876859e8bb03d9)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:23.605646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:23.722933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:23.739591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c08962bf6ce45b6b0876859e8bb03d9', 'request_id': 'req-0b4f5f79-734f-4211-9ff2-2a97f9e73429'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.746157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c08962bf6ce45b6b0876859e8bb03d9', 'request_id': 'req-0b4f5f79-734f-4211-9ff2-2a97f9e73429'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.751889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c08962bf6ce45b6b0876859e8bb03d9', 'request_id': 'req-0b4f5f79-734f-4211-9ff2-2a97f9e73429'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.832296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] The token cache is being invalidate because project 4c08962bf6ce45b6b0876859e8bb03d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:16:23.832586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.833212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:23.834824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1153/2309] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:16:23 2022] DELETE /identity/v3/projects/4c08962bf6ce45b6b0876859e8bb03d9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:23.839252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:23.840802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:23.854553 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee043d0-e743-44e1-8cd2-027c17ba9f12 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:23.868983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:23.914840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:23.915720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:23.916046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:23.916369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] PATH_INFO: `/v3/users/9a924baffec2476fb9f12341b8310ac5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:23.917752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a924baffec2476fb9f12341b8310ac5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:23.919587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:24.215469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a924baffec2476fb9f12341b8310ac5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:24.223026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a924baffec2476fb9f12341b8310ac5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:24.223727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a924baffec2476fb9f12341b8310ac5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:24.238424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a924baffec2476fb9f12341b8310ac5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:24.308053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3e63fbc-dbd2-45b3-9f52-049f370fab0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a924baffec2476fb9f12341b8310ac5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:24.328898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1157/2310] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:16:23 2022] DELETE /identity/v3/users/9a924baffec2476fb9f12341b8310ac5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:24.669120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:24.674327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:24.696002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f5f79-734f-4211-9ff2-2a97f9e73429 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:24.763404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:24.764609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:24.764900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:24.765179 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] PATH_INFO: `/v3/projects/6165e92561c24d42884498a045878552` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:24.766375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6165e92561c24d42884498a045878552)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:24.768536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:24.910801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6165e92561c24d42884498a045878552', 'request_id': 'req-ba93c640-1f51-40a1-a5ae-8662af76bc21'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:24.920391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6165e92561c24d42884498a045878552', 'request_id': 'req-ba93c640-1f51-40a1-a5ae-8662af76bc21'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:24.927128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6165e92561c24d42884498a045878552', 'request_id': 'req-ba93c640-1f51-40a1-a5ae-8662af76bc21'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:25.020481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] The token cache is being invalidate because project 6165e92561c24d42884498a045878552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:16:25.020481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:25.020481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-ba93c640-1f51-40a1-a5ae-8662af76bc21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:25.020481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1154/2311] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:16:24 2022] DELETE /identity/v3/projects/6165e92561c24d42884498a045878552 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:25.024675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea27d7-061c-490d-b5a4-4154a3e17072 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:25.025167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea27d7-061c-490d-b5a4-4154a3e17072 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:25.025467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea27d7-061c-490d-b5a4-4154a3e17072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:25.100511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-36ea27d7-061c-490d-b5a4-4154a3e17072 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:25.102352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36ea27d7-061c-490d-b5a4-4154a3e17072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:25.190068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1158/2312] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:25.197521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4bfa9-3ab1-4e7f-8742-ad92167c9e06 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:25.197974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4bfa9-3ab1-4e7f-8742-ad92167c9e06 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:25.198317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4bfa9-3ab1-4e7f-8742-ad92167c9e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:25.217491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-12c4bfa9-3ab1-4e7f-8742-ad92167c9e06 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:25.218705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-12c4bfa9-3ab1-4e7f-8742-ad92167c9e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:25.238358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1155/2313] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:25.238503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea27d7-061c-490d-b5a4-4154a3e17072 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:25.246133 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea27d7-061c-490d-b5a4-4154a3e17072 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:25.251122 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d2e22-0ff9-4813-a159-dc71d2398c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:25.251797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d2e22-0ff9-4813-a159-dc71d2398c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:25.252118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d2e22-0ff9-4813-a159-dc71d2398c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:25.252443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d2e22-0ff9-4813-a159-dc71d2398c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:25.253190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d2e22-0ff9-4813-a159-dc71d2398c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:16:25.253501 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d2e22-0ff9-4813-a159-dc71d2398c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:25.255453 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d2e22-0ff9-4813-a159-dc71d2398c8f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:25.257571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:25.296354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1159/2314] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:16:25.298552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4bfa9-3ab1-4e7f-8742-ad92167c9e06 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:25.311420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4bfa9-3ab1-4e7f-8742-ad92167c9e06 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:25.321367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55b378-4f8c-4227-a719-d59184b6498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:25.322059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55b378-4f8c-4227-a719-d59184b6498a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:25.322349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55b378-4f8c-4227-a719-d59184b6498a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:25.322631 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55b378-4f8c-4227-a719-d59184b6498a admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:25.323359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55b378-4f8c-4227-a719-d59184b6498a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:25.325596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55b378-4f8c-4227-a719-d59184b6498a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:25.440514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1156/2315] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:16:25 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:16:25.441013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d2e22-0ff9-4813-a159-dc71d2398c8f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:25.452780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d2e22-0ff9-4813-a159-dc71d2398c8f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:25.521805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b03e-d456-453c-b95a-1010b2061ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:25.522480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b03e-d456-453c-b95a-1010b2061ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:25.524480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b03e-d456-453c-b95a-1010b2061ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:25.524480 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265b03e-d456-453c-b95a-1010b2061ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:25.524673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265b03e-d456-453c-b95a-1010b2061ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:25.531310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265b03e-d456-453c-b95a-1010b2061ce5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:25.646207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55b378-4f8c-4227-a719-d59184b6498a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:25.651994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1160/2316] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:16:25 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:16:25.658002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55b378-4f8c-4227-a719-d59184b6498a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:25.669755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fca288-7c5a-4532-8d9d-62518655b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:25.670671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fca288-7c5a-4532-8d9d-62518655b10e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:25.671169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fca288-7c5a-4532-8d9d-62518655b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:25.671565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fca288-7c5a-4532-8d9d-62518655b10e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:25.672538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fca288-7c5a-4532-8d9d-62518655b10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:25.674438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fca288-7c5a-4532-8d9d-62518655b10e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:25.693655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1157/2317] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:25.697426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b03e-d456-453c-b95a-1010b2061ce5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:25.726647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265b03e-d456-453c-b95a-1010b2061ce5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:25.732276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f6128-e853-4662-a60e-0e49e6f8cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:25.733154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f6128-e853-4662-a60e-0e49e6f8cf5f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:25.735117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f6128-e853-4662-a60e-0e49e6f8cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:25.744821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f6128-e853-4662-a60e-0e49e6f8cf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:25.745626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f6128-e853-4662-a60e-0e49e6f8cf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:25.752610 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f6128-e853-4662-a60e-0e49e6f8cf5f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:25.771199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1161/2318] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:25.774632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fca288-7c5a-4532-8d9d-62518655b10e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:25.786814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fca288-7c5a-4532-8d9d-62518655b10e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:25.794147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed577545-be5c-47a3-92b8-430de23b5881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:25.802836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed577545-be5c-47a3-92b8-430de23b5881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:25.802836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed577545-be5c-47a3-92b8-430de23b5881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:25.802836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed577545-be5c-47a3-92b8-430de23b5881 admin admin] PATH_INFO: `/v3/projects/31017de47ba44a53a4ac9b2c7c54e9b2/users/3510ed6d9bb041aea0e95964fa031e05/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:25.802836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:25.815919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed577545-be5c-47a3-92b8-430de23b5881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31017de47ba44a53a4ac9b2c7c54e9b2, user_id=3510ed6d9bb041aea0e95964fa031e05, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:25.818846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed577545-be5c-47a3-92b8-430de23b5881 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:25.936010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1158/2319] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:25 2022] PUT /identity/v3/projects/31017de47ba44a53a4ac9b2c7c54e9b2/users/3510ed6d9bb041aea0e95964fa031e05/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:25.938059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0288f-a525-423a-9b12-e17759bd4d91 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:25.938378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0288f-a525-423a-9b12-e17759bd4d91 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:25.938658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0288f-a525-423a-9b12-e17759bd4d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:25.974364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fee0288f-a525-423a-9b12-e17759bd4d91 None None] MFA Rules not processed for user `3510ed6d9bb041aea0e95964fa031e05`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:25.975651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fee0288f-a525-423a-9b12-e17759bd4d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:26.114945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1162/2320] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:26.120619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed577545-be5c-47a3-92b8-430de23b5881 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:26.193494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed577545-be5c-47a3-92b8-430de23b5881 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:26.211573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953bc0d-f8f9-4ed8-bacd-2c9568f35f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:26.212559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953bc0d-f8f9-4ed8-bacd-2c9568f35f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:26.212847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953bc0d-f8f9-4ed8-bacd-2c9568f35f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:26.213427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953bc0d-f8f9-4ed8-bacd-2c9568f35f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:26.213918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953bc0d-f8f9-4ed8-bacd-2c9568f35f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:26.217041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953bc0d-f8f9-4ed8-bacd-2c9568f35f79 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:26.361860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0288f-a525-423a-9b12-e17759bd4d91 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:26.363656 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1159/2321] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:16:26 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:16:26.375197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0288f-a525-423a-9b12-e17759bd4d91 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:26.451898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1b375-77f1-4702-aced-f1e12353cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:26.452595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1b375-77f1-4702-aced-f1e12353cf03 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:26.452882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1b375-77f1-4702-aced-f1e12353cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:26.453162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1b375-77f1-4702-aced-f1e12353cf03 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:26.453868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1b375-77f1-4702-aced-f1e12353cf03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:26.457005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1b375-77f1-4702-aced-f1e12353cf03 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:26.467355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:26.552724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1163/2322] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:16:26 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:16:26.557439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953bc0d-f8f9-4ed8-bacd-2c9568f35f79 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:26.575560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953bc0d-f8f9-4ed8-bacd-2c9568f35f79 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:26.581955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff147341-9cd3-4ac6-abf1-8575379894a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:26.582628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff147341-9cd3-4ac6-abf1-8575379894a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:26.582963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff147341-9cd3-4ac6-abf1-8575379894a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:26.583243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff147341-9cd3-4ac6-abf1-8575379894a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:26.584012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff147341-9cd3-4ac6-abf1-8575379894a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:26.585798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff147341-9cd3-4ac6-abf1-8575379894a3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:26.597137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1160/2323] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:26.602073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1b375-77f1-4702-aced-f1e12353cf03 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:26.614607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1b375-77f1-4702-aced-f1e12353cf03 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:26.620546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29427-6ebc-494e-af88-179f04a89ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:26.621487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29427-6ebc-494e-af88-179f04a89ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:26.621769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29427-6ebc-494e-af88-179f04a89ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:26.622044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29427-6ebc-494e-af88-179f04a89ef1 admin admin] PATH_INFO: `/v3/projects/698a1e47bebc43118b04143afa9d3d98/users/7e7612b381d64cfaa511d54df3334ab4/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:26.639212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29427-6ebc-494e-af88-179f04a89ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698a1e47bebc43118b04143afa9d3d98, user_id=7e7612b381d64cfaa511d54df3334ab4, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:26.641894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29427-6ebc-494e-af88-179f04a89ef1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:26.707482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1164/2324] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:26 2022] PUT /identity/v3/projects/698a1e47bebc43118b04143afa9d3d98/users/7e7612b381d64cfaa511d54df3334ab4/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:26.708367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff147341-9cd3-4ac6-abf1-8575379894a3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:26.722661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff147341-9cd3-4ac6-abf1-8575379894a3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:26.799027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb0ef0-3a2a-41da-936a-c1007ebcf1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:26.800142 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb0ef0-3a2a-41da-936a-c1007ebcf1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:26.800281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb0ef0-3a2a-41da-936a-c1007ebcf1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:26.800558 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb0ef0-3a2a-41da-936a-c1007ebcf1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:26.803812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb0ef0-3a2a-41da-936a-c1007ebcf1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:26.806054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb0ef0-3a2a-41da-936a-c1007ebcf1c7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:26.817317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1161/2325] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:26.825283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29427-6ebc-494e-af88-179f04a89ef1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:26.838274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29427-6ebc-494e-af88-179f04a89ef1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:26.848031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af166e-526d-46a8-bbe0-7d92353492f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:26.849028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af166e-526d-46a8-bbe0-7d92353492f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:26.849371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af166e-526d-46a8-bbe0-7d92353492f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:26.849724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af166e-526d-46a8-bbe0-7d92353492f1 admin admin] PATH_INFO: `/v3/projects/698a1e47bebc43118b04143afa9d3d98/users/7e7612b381d64cfaa511d54df3334ab4/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:26.857054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af166e-526d-46a8-bbe0-7d92353492f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698a1e47bebc43118b04143afa9d3d98, user_id=7e7612b381d64cfaa511d54df3334ab4, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:26.859763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af166e-526d-46a8-bbe0-7d92353492f1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:26.877490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1165/2326] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:26 2022] PUT /identity/v3/projects/698a1e47bebc43118b04143afa9d3d98/users/7e7612b381d64cfaa511d54df3334ab4/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:26.891375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f53c82-c14f-4bbd-b101-359b6492fc85 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:26.891668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f53c82-c14f-4bbd-b101-359b6492fc85 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:26.891983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f53c82-c14f-4bbd-b101-359b6492fc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:26.920145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-42f53c82-c14f-4bbd-b101-359b6492fc85 None None] MFA Rules not processed for user `7e7612b381d64cfaa511d54df3334ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:26.921664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-42f53c82-c14f-4bbd-b101-359b6492fc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:26.965718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:26.996146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1162/2327] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:27.008400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af166e-526d-46a8-bbe0-7d92353492f1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:27.010194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f5af166e-526d-46a8-bbe0-7d92353492f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:27.093126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af166e-526d-46a8-bbe0-7d92353492f1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:27.096751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733b7af-7ce7-441d-bb62-592503222919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:27.097397 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b7af-7ce7-441d-bb62-592503222919 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:27.097683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b7af-7ce7-441d-bb62-592503222919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:27.097964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b7af-7ce7-441d-bb62-592503222919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:27.155863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733b7af-7ce7-441d-bb62-592503222919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:27.157343 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733b7af-7ce7-441d-bb62-592503222919 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:27.166169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1166/2328] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:16:31.276438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f53c82-c14f-4bbd-b101-359b6492fc85 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:31.338817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f53c82-c14f-4bbd-b101-359b6492fc85 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:31.343494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:31.344410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:31.344690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:31.344964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] PATH_INFO: `/v3/users/3510ed6d9bb041aea0e95964fa031e05` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:31.346149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3510ed6d9bb041aea0e95964fa031e05)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:31.348112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:31.511937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3510ed6d9bb041aea0e95964fa031e05'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:31.525571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3510ed6d9bb041aea0e95964fa031e05'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:31.642793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3510ed6d9bb041aea0e95964fa031e05'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:31.643413 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3510ed6d9bb041aea0e95964fa031e05'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:31.656325 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3510ed6d9bb041aea0e95964fa031e05'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:31.662552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1163/2329] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:16:31 2022] DELETE /identity/v3/users/3510ed6d9bb041aea0e95964fa031e05 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:31.667637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6eeae-d968-43bb-92e1-6b941f3abc3c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:31.668176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6eeae-d968-43bb-92e1-6b941f3abc3c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:31.668295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6eeae-d968-43bb-92e1-6b941f3abc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:31.686201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3eb6eeae-d968-43bb-92e1-6b941f3abc3c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:31.687566 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3eb6eeae-d968-43bb-92e1-6b941f3abc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:31.735850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:31.748366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1167/2330] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:31.758425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:31.759814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:31.827986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:31.844071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897eb3a-deda-4e81-9067-a77c6c1133c4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:31.847795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe897-56e3-4e53-a266-d2be11c39142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:31.848493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe897-56e3-4e53-a266-d2be11c39142 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:31.848776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe897-56e3-4e53-a266-d2be11c39142 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:31.849054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbe897-56e3-4e53-a266-d2be11c39142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:31.859264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbe897-56e3-4e53-a266-d2be11c39142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:31.860747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbe897-56e3-4e53-a266-d2be11c39142 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:31.870085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1164/2331] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:16:32.326904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6eeae-d968-43bb-92e1-6b941f3abc3c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:32.328355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3eb6eeae-d968-43bb-92e1-6b941f3abc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:32.343215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6eeae-d968-43bb-92e1-6b941f3abc3c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:32.347802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:32.348756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:32.349041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:32.349317 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] PATH_INFO: `/v3/projects/31017de47ba44a53a4ac9b2c7c54e9b2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:32.351806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31017de47ba44a53a4ac9b2c7c54e9b2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:32.354552 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:32.472097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31017de47ba44a53a4ac9b2c7c54e9b2', 'request_id': 'req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.530675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31017de47ba44a53a4ac9b2c7c54e9b2', 'request_id': 'req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.538135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31017de47ba44a53a4ac9b2c7c54e9b2', 'request_id': 'req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.551576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] The token cache is being invalidate because project 31017de47ba44a53a4ac9b2c7c54e9b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:16:32.551891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.552638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.554242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1168/2332] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:16:32 2022] DELETE /identity/v3/projects/31017de47ba44a53a4ac9b2c7c54e9b2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:32.559028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe897-56e3-4e53-a266-d2be11c39142 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:32.568930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbe897-56e3-4e53-a266-d2be11c39142 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:32.630549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:32.631538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:32.631818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:32.632122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] PATH_INFO: `/v3/users/7e7612b381d64cfaa511d54df3334ab4` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:32.633964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7612b381d64cfaa511d54df3334ab4)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:32.635918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:32.814427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7612b381d64cfaa511d54df3334ab4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.822565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7612b381d64cfaa511d54df3334ab4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.906107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7612b381d64cfaa511d54df3334ab4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.906657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7612b381d64cfaa511d54df3334ab4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.920551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-063dc3f7-7983-499a-9dc5-fa3ada2d7306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7612b381d64cfaa511d54df3334ab4'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:32.927155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1165/2333] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:16:32 2022] DELETE /identity/v3/users/7e7612b381d64cfaa511d54df3334ab4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:33.532312 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:33.533808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:33.548551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b7fe4-2e8d-4b3d-883f-65abc99b9f03 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:33.613216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:33.614092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:33.614372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:33.614653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] PATH_INFO: `/v3/projects/698a1e47bebc43118b04143afa9d3d98` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:33.615865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698a1e47bebc43118b04143afa9d3d98)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:33.618856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:33.722803 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698a1e47bebc43118b04143afa9d3d98', 'request_id': 'req-684321cf-dc34-4c18-b64c-85a1a5c6edb9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:33.816557 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698a1e47bebc43118b04143afa9d3d98', 'request_id': 'req-684321cf-dc34-4c18-b64c-85a1a5c6edb9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:33.827963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698a1e47bebc43118b04143afa9d3d98', 'request_id': 'req-684321cf-dc34-4c18-b64c-85a1a5c6edb9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:33.847629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] The token cache is being invalidate because project 698a1e47bebc43118b04143afa9d3d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:16:33.848105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:33.848866 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:33.863900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1169/2334] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:16:33 2022] DELETE /identity/v3/projects/698a1e47bebc43118b04143afa9d3d98 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:39.076053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158e97-d8a9-4837-86e0-62b5287f6da6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:39.076552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158e97-d8a9-4837-86e0-62b5287f6da6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:39.076662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09158e97-d8a9-4837-86e0-62b5287f6da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:39.107122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-09158e97-d8a9-4837-86e0-62b5287f6da6 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:39.108600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-09158e97-d8a9-4837-86e0-62b5287f6da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:39.154073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:39.172222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1166/2335] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:39.215693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:39.223662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:39.227185 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:39.288154 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684321cf-dc34-4c18-b64c-85a1a5c6edb9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:39.294464 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85842bba-2000-4594-8e29-22609d71d341 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:39.295122 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85842bba-2000-4594-8e29-22609d71d341 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:39.295409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85842bba-2000-4594-8e29-22609d71d341 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:39.295683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85842bba-2000-4594-8e29-22609d71d341 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:39.304647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85842bba-2000-4594-8e29-22609d71d341 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:39.306272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85842bba-2000-4594-8e29-22609d71d341 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:39.315647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1170/2336] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:16:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:16:40.165903 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747fcbb-e8e0-413c-b846-c4acaca920a6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:40.166491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747fcbb-e8e0-413c-b846-c4acaca920a6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:40.166491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747fcbb-e8e0-413c-b846-c4acaca920a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:40.184624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1747fcbb-e8e0-413c-b846-c4acaca920a6 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:40.187434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1747fcbb-e8e0-413c-b846-c4acaca920a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:40.192971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1167/2337] 10.222.0.49 () {58 vars in 967 bytes} [Tue Jun 28 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:40.206112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85842bba-2000-4594-8e29-22609d71d341 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:40.216726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85842bba-2000-4594-8e29-22609d71d341 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:40.221781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe27f69-2c1d-499d-84b5-3cbafc620abb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:40.222414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe27f69-2c1d-499d-84b5-3cbafc620abb service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:40.222699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe27f69-2c1d-499d-84b5-3cbafc620abb service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:40.222977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe27f69-2c1d-499d-84b5-3cbafc620abb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:40.232255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe27f69-2c1d-499d-84b5-3cbafc620abb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:40.233855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe27f69-2c1d-499d-84b5-3cbafc620abb service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:40.243076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1171/2338] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:16:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:16:40.860106 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7ec03-b0c2-4285-ad35-c2ab3f0cdf1a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:40.860397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7ec03-b0c2-4285-ad35-c2ab3f0cdf1a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:40.860674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7ec03-b0c2-4285-ad35-c2ab3f0cdf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:40.878191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-33b7ec03-b0c2-4285-ad35-c2ab3f0cdf1a None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:40.879374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-33b7ec03-b0c2-4285-ad35-c2ab3f0cdf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:40.886567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1168/2339] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:40.898753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe27f69-2c1d-499d-84b5-3cbafc620abb service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:40.910222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe27f69-2c1d-499d-84b5-3cbafc620abb service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:40.915527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbeb3e-4e92-4765-9c6e-ce40d2e3cf16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:40.916943 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbeb3e-4e92-4765-9c6e-ce40d2e3cf16 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:40.917285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbeb3e-4e92-4765-9c6e-ce40d2e3cf16 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:40.917567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbeb3e-4e92-4765-9c6e-ce40d2e3cf16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:40.926391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbeb3e-4e92-4765-9c6e-ce40d2e3cf16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:40.928009 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbeb3e-4e92-4765-9c6e-ce40d2e3cf16 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:40.936441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1172/2340] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:16:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:16:41.542815 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1b97-990a-4a76-a528-a3de6b4fcfdf None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:41.543256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1b97-990a-4a76-a528-a3de6b4fcfdf None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:41.543426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da1b97-990a-4a76-a528-a3de6b4fcfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:41.564312 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b2da1b97-990a-4a76-a528-a3de6b4fcfdf None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:41.565632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b2da1b97-990a-4a76-a528-a3de6b4fcfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:41.573433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1169/2341] 10.222.0.49 () {58 vars in 967 bytes} [Tue Jun 28 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:41.590416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbeb3e-4e92-4765-9c6e-ce40d2e3cf16 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:41.601944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbeb3e-4e92-4765-9c6e-ce40d2e3cf16 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:41.609526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475c2fa-9b33-4f1d-ac1c-f9336fec4c9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:41.610190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475c2fa-9b33-4f1d-ac1c-f9336fec4c9f service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:41.610478 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475c2fa-9b33-4f1d-ac1c-f9336fec4c9f service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:41.610760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475c2fa-9b33-4f1d-ac1c-f9336fec4c9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:41.619572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475c2fa-9b33-4f1d-ac1c-f9336fec4c9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:41.621200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475c2fa-9b33-4f1d-ac1c-f9336fec4c9f service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:41.629850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1173/2342] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:16:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:16:44.805574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da1b97-990a-4a76-a528-a3de6b4fcfdf None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:44.807036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b2da1b97-990a-4a76-a528-a3de6b4fcfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:44.873562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da1b97-990a-4a76-a528-a3de6b4fcfdf None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:44.877950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:44.878818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:44.879099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:44.879373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] PATH_INFO: `/v3/users/c945b7a697f241c6a01553035d85249b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:44.880726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c945b7a697f241c6a01553035d85249b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:44.882659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:45.057997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c945b7a697f241c6a01553035d85249b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.065404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c945b7a697f241c6a01553035d85249b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.141824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c945b7a697f241c6a01553035d85249b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.142407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c945b7a697f241c6a01553035d85249b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.155826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c945b7a697f241c6a01553035d85249b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.161789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1170/2343] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:16:44 2022] DELETE /identity/v3/users/c945b7a697f241c6a01553035d85249b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:45.166328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec9adc-80cd-461c-bc21-c787b8789f9d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:45.167460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec9adc-80cd-461c-bc21-c787b8789f9d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:45.167673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec9adc-80cd-461c-bc21-c787b8789f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:45.185209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-14ec9adc-80cd-461c-bc21-c787b8789f9d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:45.186430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-14ec9adc-80cd-461c-bc21-c787b8789f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:45.244522 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1174/2344] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:45.254437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:45.255893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:45.309194 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:45.312880 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383397b-ba19-4f0d-ba85-812a2eecdd2f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:45.316578 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023bb4f-e8bb-4b1e-ac1a-d3e2412ce42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:45.317216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023bb4f-e8bb-4b1e-ac1a-d3e2412ce42c service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:45.317501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023bb4f-e8bb-4b1e-ac1a-d3e2412ce42c service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:45.323052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023bb4f-e8bb-4b1e-ac1a-d3e2412ce42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:45.326818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023bb4f-e8bb-4b1e-ac1a-d3e2412ce42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:45.328291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023bb4f-e8bb-4b1e-ac1a-d3e2412ce42c service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:45.337706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1171/2345] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:16:45.581431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec9adc-80cd-461c-bc21-c787b8789f9d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:45.582873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-14ec9adc-80cd-461c-bc21-c787b8789f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:45.602587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec9adc-80cd-461c-bc21-c787b8789f9d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:45.608615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:45.609783 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:45.610342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:45.610814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] PATH_INFO: `/v3/projects/2522fe91198f4b77b5b1f3b64c3ea7f3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:45.612560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2522fe91198f4b77b5b1f3b64c3ea7f3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:45.614564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:45.734625 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2522fe91198f4b77b5b1f3b64c3ea7f3', 'request_id': 'req-2f260294-6f8c-47ec-b723-d478caa1e03d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.737180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:45.847609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2522fe91198f4b77b5b1f3b64c3ea7f3', 'request_id': 'req-2f260294-6f8c-47ec-b723-d478caa1e03d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.854313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2522fe91198f4b77b5b1f3b64c3ea7f3', 'request_id': 'req-2f260294-6f8c-47ec-b723-d478caa1e03d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.865413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] The token cache is being invalidate because project 2522fe91198f4b77b5b1f3b64c3ea7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:16:45.865703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.866334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2f260294-6f8c-47ec-b723-d478caa1e03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:45.867889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1175/2346] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:16:45 2022] DELETE /identity/v3/projects/2522fe91198f4b77b5b1f3b64c3ea7f3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:45.873323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac701aa-f497-4f51-842e-1b831dbb5a0d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:45.873761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac701aa-f497-4f51-842e-1b831dbb5a0d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:45.873904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac701aa-f497-4f51-842e-1b831dbb5a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:45.892091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3ac701aa-f497-4f51-842e-1b831dbb5a0d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:45.893332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3ac701aa-f497-4f51-842e-1b831dbb5a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:45.953128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1172/2347] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:45.961045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a509c24-331f-4741-bd9e-8b3684d98a3e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:45.961398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a509c24-331f-4741-bd9e-8b3684d98a3e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:45.961717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a509c24-331f-4741-bd9e-8b3684d98a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:45.981846 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9a509c24-331f-4741-bd9e-8b3684d98a3e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:45.983051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a509c24-331f-4741-bd9e-8b3684d98a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:45.990991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1176/2348] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:45.999352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac701aa-f497-4f51-842e-1b831dbb5a0d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:46.009093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac701aa-f497-4f51-842e-1b831dbb5a0d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:46.015483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd51b8-5bb4-4d3b-9c58-f444f3544a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:46.016163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd51b8-5bb4-4d3b-9c58-f444f3544a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:46.016447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd51b8-5bb4-4d3b-9c58-f444f3544a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:46.016718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd51b8-5bb4-4d3b-9c58-f444f3544a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:46.017440 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd51b8-5bb4-4d3b-9c58-f444f3544a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:16:46.017744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd51b8-5bb4-4d3b-9c58-f444f3544a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:46.019347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd51b8-5bb4-4d3b-9c58-f444f3544a97 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:46.031745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1173/2349] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:16:46.036124 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a509c24-331f-4741-bd9e-8b3684d98a3e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:46.045595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a509c24-331f-4741-bd9e-8b3684d98a3e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:46.050199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1b95-bf51-41e9-9218-f71c98a8222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:46.050847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1b95-bf51-41e9-9218-f71c98a8222b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:46.051132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1b95-bf51-41e9-9218-f71c98a8222b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:46.051408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1b95-bf51-41e9-9218-f71c98a8222b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:46.052292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e1b95-bf51-41e9-9218-f71c98a8222b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:46.054204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e1b95-bf51-41e9-9218-f71c98a8222b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:46.152860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1177/2350] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:16:46 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:16:46.157027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd51b8-5bb4-4d3b-9c58-f444f3544a97 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:46.166801 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd51b8-5bb4-4d3b-9c58-f444f3544a97 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:46.222493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cb5fb-2e72-4ee5-a3e0-f96658cdb6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:46.223082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cb5fb-2e72-4ee5-a3e0-f96658cdb6ec admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:46.223362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cb5fb-2e72-4ee5-a3e0-f96658cdb6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:46.223633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cb5fb-2e72-4ee5-a3e0-f96658cdb6ec admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:46.224361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cb5fb-2e72-4ee5-a3e0-f96658cdb6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:46.226277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cb5fb-2e72-4ee5-a3e0-f96658cdb6ec admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:46.333408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1174/2351] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:16:46 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:16:46.337518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1b95-bf51-41e9-9218-f71c98a8222b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:46.347776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1b95-bf51-41e9-9218-f71c98a8222b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:46.352418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bc8d5-17a7-4270-b7c4-9ea79dcb6e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:46.353071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bc8d5-17a7-4270-b7c4-9ea79dcb6e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:46.353357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bc8d5-17a7-4270-b7c4-9ea79dcb6e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:46.353638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bc8d5-17a7-4270-b7c4-9ea79dcb6e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:46.354391 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bc8d5-17a7-4270-b7c4-9ea79dcb6e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:46.356063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bc8d5-17a7-4270-b7c4-9ea79dcb6e85 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:46.366313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1178/2352] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:46.370054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cb5fb-2e72-4ee5-a3e0-f96658cdb6ec admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:46.380610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cb5fb-2e72-4ee5-a3e0-f96658cdb6ec admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:46.385184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ac83c-7a32-467a-9f66-f69b30bd4924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:46.385827 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ac83c-7a32-467a-9f66-f69b30bd4924 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:46.386110 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ac83c-7a32-467a-9f66-f69b30bd4924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:46.387251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ac83c-7a32-467a-9f66-f69b30bd4924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:46.388203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ac83c-7a32-467a-9f66-f69b30bd4924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:46.389791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ac83c-7a32-467a-9f66-f69b30bd4924 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:46.399487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1175/2353] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:46.403380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bc8d5-17a7-4270-b7c4-9ea79dcb6e85 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:46.413183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bc8d5-17a7-4270-b7c4-9ea79dcb6e85 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:46.417673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff55e5-919c-4488-a2d2-16da42c2ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:46.418546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff55e5-919c-4488-a2d2-16da42c2ecee admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:46.418826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff55e5-919c-4488-a2d2-16da42c2ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:46.419098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff55e5-919c-4488-a2d2-16da42c2ecee admin admin] PATH_INFO: `/v3/projects/f9fefcc629a243e59351c96303395e2b/users/7603d50657514c2d9e1ed22abccf972b/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:46.433208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff55e5-919c-4488-a2d2-16da42c2ecee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9fefcc629a243e59351c96303395e2b, user_id=7603d50657514c2d9e1ed22abccf972b, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:46.436417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff55e5-919c-4488-a2d2-16da42c2ecee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:46.536228 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1179/2354] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:46 2022] PUT /identity/v3/projects/f9fefcc629a243e59351c96303395e2b/users/7603d50657514c2d9e1ed22abccf972b/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:46.541152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b03c6a-4d62-41bf-82c4-396d04765c5a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:46.545622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b03c6a-4d62-41bf-82c4-396d04765c5a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:46.545622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b03c6a-4d62-41bf-82c4-396d04765c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:46.560724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e7b03c6a-4d62-41bf-82c4-396d04765c5a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:46.561945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e7b03c6a-4d62-41bf-82c4-396d04765c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:46.616964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:46.628105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1176/2355] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:46.638319 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff55e5-919c-4488-a2d2-16da42c2ecee admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:46.640044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-20ff55e5-919c-4488-a2d2-16da42c2ecee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:46.695998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff55e5-919c-4488-a2d2-16da42c2ecee admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:46.700237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ba139-9b1e-4782-ad59-c078d33342fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:46.700877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ba139-9b1e-4782-ad59-c078d33342fc service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:46.701161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ba139-9b1e-4782-ad59-c078d33342fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:46.701437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ba139-9b1e-4782-ad59-c078d33342fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:46.710784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ba139-9b1e-4782-ad59-c078d33342fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:46.712247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ba139-9b1e-4782-ad59-c078d33342fc service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:46.722541 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1180/2356] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:16:52.303582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb86f-e0b6-46d6-a10c-996067598a62 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:52.304338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb86f-e0b6-46d6-a10c-996067598a62 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:52.304623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54eb86f-e0b6-46d6-a10c-996067598a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:52.341636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c54eb86f-e0b6-46d6-a10c-996067598a62 None None] MFA Rules not processed for user `7603d50657514c2d9e1ed22abccf972b`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:52.342832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c54eb86f-e0b6-46d6-a10c-996067598a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:52.443297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1177/2357] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:52.448046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ba139-9b1e-4782-ad59-c078d33342fc service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:52.462331 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ba139-9b1e-4782-ad59-c078d33342fc service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:52.468619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5ea65-8e14-4bd1-814b-012a262d121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:52.469297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5ea65-8e14-4bd1-814b-012a262d121a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:52.469582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5ea65-8e14-4bd1-814b-012a262d121a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:52.470047 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5ea65-8e14-4bd1-814b-012a262d121a admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:52.470912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5ea65-8e14-4bd1-814b-012a262d121a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:52.473085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5ea65-8e14-4bd1-814b-012a262d121a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:52.572997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1181/2358] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:16:52 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:16:52.577758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb86f-e0b6-46d6-a10c-996067598a62 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:52.590535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54eb86f-e0b6-46d6-a10c-996067598a62 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:52.649724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5f947-05c2-4747-8304-6574b3c96bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:52.650428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f947-05c2-4747-8304-6574b3c96bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:52.650776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f947-05c2-4747-8304-6574b3c96bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:52.651121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f947-05c2-4747-8304-6574b3c96bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:52.652511 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5f947-05c2-4747-8304-6574b3c96bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:52.654575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5f947-05c2-4747-8304-6574b3c96bb7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:52.778812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1178/2359] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:16:52 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:16:52.781495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5ea65-8e14-4bd1-814b-012a262d121a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:52.792531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5ea65-8e14-4bd1-814b-012a262d121a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:52.797749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86deefd-a425-4bf6-ab31-0ff213f0679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:52.798426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86deefd-a425-4bf6-ab31-0ff213f0679b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:52.798711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86deefd-a425-4bf6-ab31-0ff213f0679b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:52.798986 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86deefd-a425-4bf6-ab31-0ff213f0679b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:52.799801 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86deefd-a425-4bf6-ab31-0ff213f0679b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:52.801472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86deefd-a425-4bf6-ab31-0ff213f0679b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:52.813278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1182/2360] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:52.819402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5f947-05c2-4747-8304-6574b3c96bb7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:52.844114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5f947-05c2-4747-8304-6574b3c96bb7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:52.850720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdeed9-995c-467a-aaae-6944f928c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:52.851633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdeed9-995c-467a-aaae-6944f928c9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:52.851960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdeed9-995c-467a-aaae-6944f928c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:52.852249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdeed9-995c-467a-aaae-6944f928c9a5 admin admin] PATH_INFO: `/v3/projects/3c893cec1115421c9600ceb921f12a12/users/c8e13f0777b244e39bb708bb9c2adfca/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:52.868703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdeed9-995c-467a-aaae-6944f928c9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c893cec1115421c9600ceb921f12a12, user_id=c8e13f0777b244e39bb708bb9c2adfca, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:52.871425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdeed9-995c-467a-aaae-6944f928c9a5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:53.010996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1179/2361] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:52 2022] PUT /identity/v3/projects/3c893cec1115421c9600ceb921f12a12/users/c8e13f0777b244e39bb708bb9c2adfca/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:53.015603 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86deefd-a425-4bf6-ab31-0ff213f0679b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:53.029455 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86deefd-a425-4bf6-ab31-0ff213f0679b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:53.082722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:53.095010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625653c-0014-48ec-b99d-95d563407b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:53.095732 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625653c-0014-48ec-b99d-95d563407b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:53.096051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625653c-0014-48ec-b99d-95d563407b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:53.096351 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625653c-0014-48ec-b99d-95d563407b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:53.097152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625653c-0014-48ec-b99d-95d563407b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:53.098789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625653c-0014-48ec-b99d-95d563407b23 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:53.109428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1183/2362] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:53.113671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdeed9-995c-467a-aaae-6944f928c9a5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:53.126839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdeed9-995c-467a-aaae-6944f928c9a5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:53.132023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e6437-09db-450b-a22d-324812b9e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:53.132954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e6437-09db-450b-a22d-324812b9e4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:53.133239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e6437-09db-450b-a22d-324812b9e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:53.133513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e6437-09db-450b-a22d-324812b9e4e3 admin admin] PATH_INFO: `/v3/projects/3c893cec1115421c9600ceb921f12a12/users/c8e13f0777b244e39bb708bb9c2adfca/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:53.135807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e6437-09db-450b-a22d-324812b9e4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c893cec1115421c9600ceb921f12a12, user_id=c8e13f0777b244e39bb708bb9c2adfca, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:53.139284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e6437-09db-450b-a22d-324812b9e4e3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:53.150506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1180/2363] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:53 2022] PUT /identity/v3/projects/3c893cec1115421c9600ceb921f12a12/users/c8e13f0777b244e39bb708bb9c2adfca/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:16:56.371424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625653c-0014-48ec-b99d-95d563407b23 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:56.373283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d625653c-0014-48ec-b99d-95d563407b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:56.390792 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625653c-0014-48ec-b99d-95d563407b23 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:56.499974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:56.501205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:56.501648 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:56.502084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] PATH_INFO: `/v3/users/0eb14f2ee3d849f4a42e42fe175ddeb6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:56.505212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb14f2ee3d849f4a42e42fe175ddeb6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:56.509461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:56.753443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb14f2ee3d849f4a42e42fe175ddeb6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:56.779828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb14f2ee3d849f4a42e42fe175ddeb6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:56.780674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb14f2ee3d849f4a42e42fe175ddeb6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:56.799177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb14f2ee3d849f4a42e42fe175ddeb6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:56.901438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb14f2ee3d849f4a42e42fe175ddeb6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:56.910414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1184/2364] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:16:56 2022] DELETE /identity/v3/users/0eb14f2ee3d849f4a42e42fe175ddeb6 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:56.915061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb048-1ef4-4e09-837a-4419a4c6004a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:56.915566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb048-1ef4-4e09-837a-4419a4c6004a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:56.915952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb048-1ef4-4e09-837a-4419a4c6004a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:56.938566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f1cfb048-1ef4-4e09-837a-4419a4c6004a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:56.940052 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f1cfb048-1ef4-4e09-837a-4419a4c6004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:57.006545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:57.052605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1181/2365] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:57.062069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:57.063602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:57.156592 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809bde2-1416-43f1-87fd-b8b86f59be86 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:57.161085 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7215c2-e2aa-411d-804d-2e9f509c71ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:57.162688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7215c2-e2aa-411d-804d-2e9f509c71ea service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:57.162688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7215c2-e2aa-411d-804d-2e9f509c71ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:57.163152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7215c2-e2aa-411d-804d-2e9f509c71ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:57.178008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7215c2-e2aa-411d-804d-2e9f509c71ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:57.179905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7215c2-e2aa-411d-804d-2e9f509c71ea service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:57.200919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1185/2366] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:16:57.863984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb048-1ef4-4e09-837a-4419a4c6004a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:57.865560 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f1cfb048-1ef4-4e09-837a-4419a4c6004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:57.881101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb048-1ef4-4e09-837a-4419a4c6004a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:57.890184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:57.891513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:57.891847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:57.892259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] PATH_INFO: `/v3/projects/5f0d9be370144da1a2a39010702c0c6e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:57.893649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0d9be370144da1a2a39010702c0c6e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:57.896241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:58.060734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0d9be370144da1a2a39010702c0c6e', 'request_id': 'req-63cdc013-34f2-413e-ba62-7912885ae324'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:58.067501 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0d9be370144da1a2a39010702c0c6e', 'request_id': 'req-63cdc013-34f2-413e-ba62-7912885ae324'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:58.074912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0d9be370144da1a2a39010702c0c6e', 'request_id': 'req-63cdc013-34f2-413e-ba62-7912885ae324'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:58.205370 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] The token cache is being invalidate because project 5f0d9be370144da1a2a39010702c0c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:16:58.205370 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:58.206664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-63cdc013-34f2-413e-ba62-7912885ae324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:16:58.215010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1182/2367] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:16:57 2022] DELETE /identity/v3/projects/5f0d9be370144da1a2a39010702c0c6e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:58.217390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0500a-9153-4bff-90b6-7c9c643e0234 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:58.217851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0500a-9153-4bff-90b6-7c9c643e0234 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:58.217941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0500a-9153-4bff-90b6-7c9c643e0234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:58.234423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:58.255922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a7f0500a-9153-4bff-90b6-7c9c643e0234 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:58.255922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a7f0500a-9153-4bff-90b6-7c9c643e0234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:58.369439 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1186/2368] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:58.380128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e336f-afc5-47e5-97ee-583fea67770d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:58.380658 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e336f-afc5-47e5-97ee-583fea67770d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:58.381139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e336f-afc5-47e5-97ee-583fea67770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:58.402518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-cf0e336f-afc5-47e5-97ee-583fea67770d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:58.404007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cf0e336f-afc5-47e5-97ee-583fea67770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:58.413086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1183/2369] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:16:58.417962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0500a-9153-4bff-90b6-7c9c643e0234 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:58.427797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0500a-9153-4bff-90b6-7c9c643e0234 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:58.433361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738aebd-07c9-40de-af30-adbab884d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:58.434063 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738aebd-07c9-40de-af30-adbab884d14c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:58.436164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738aebd-07c9-40de-af30-adbab884d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:58.436164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738aebd-07c9-40de-af30-adbab884d14c admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:58.436164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738aebd-07c9-40de-af30-adbab884d14c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:16:58.436164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738aebd-07c9-40de-af30-adbab884d14c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:58.437811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738aebd-07c9-40de-af30-adbab884d14c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:58.450876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1187/2370] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:16:58.454923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e336f-afc5-47e5-97ee-583fea67770d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:58.466177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e336f-afc5-47e5-97ee-583fea67770d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:58.471644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0905-1e25-41e3-ae16-c4c791d9c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:58.472435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0905-1e25-41e3-ae16-c4c791d9c285 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:58.472850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0905-1e25-41e3-ae16-c4c791d9c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:58.473152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0905-1e25-41e3-ae16-c4c791d9c285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:58.474545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0905-1e25-41e3-ae16-c4c791d9c285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:58.476742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0905-1e25-41e3-ae16-c4c791d9c285 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:58.612470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1184/2371] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:16:58 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:16:58.613875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738aebd-07c9-40de-af30-adbab884d14c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:58.629664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738aebd-07c9-40de-af30-adbab884d14c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:58.706530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fa59b-4527-46e2-90e0-8e248f42d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:58.707189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fa59b-4527-46e2-90e0-8e248f42d975 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:58.707473 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fa59b-4527-46e2-90e0-8e248f42d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:58.707751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fa59b-4527-46e2-90e0-8e248f42d975 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:58.708846 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fa59b-4527-46e2-90e0-8e248f42d975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:58.710830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fa59b-4527-46e2-90e0-8e248f42d975 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:58.868151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1188/2372] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:16:58 2022] POST /identity/v3/users => generated 295 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:16:58.873150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0905-1e25-41e3-ae16-c4c791d9c285 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:58.884951 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0905-1e25-41e3-ae16-c4c791d9c285 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:58.890363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915449b6-92a7-44e2-a06f-14ebce735229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:58.891251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915449b6-92a7-44e2-a06f-14ebce735229 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:58.892800 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915449b6-92a7-44e2-a06f-14ebce735229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:58.893175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915449b6-92a7-44e2-a06f-14ebce735229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:58.894162 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915449b6-92a7-44e2-a06f-14ebce735229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:58.895810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915449b6-92a7-44e2-a06f-14ebce735229 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:58.912105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1185/2373] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:16:58.912945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fa59b-4527-46e2-90e0-8e248f42d975 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:58.927196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fa59b-4527-46e2-90e0-8e248f42d975 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:58.937279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30f174-f931-434d-b536-2b00b47ab2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:58.944216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30f174-f931-434d-b536-2b00b47ab2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:58.944216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30f174-f931-434d-b536-2b00b47ab2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:58.944216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30f174-f931-434d-b536-2b00b47ab2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:58.944216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30f174-f931-434d-b536-2b00b47ab2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:58.944216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30f174-f931-434d-b536-2b00b47ab2f8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:58.960726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915449b6-92a7-44e2-a06f-14ebce735229 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:58.971279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1189/2374] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:16:58.976016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915449b6-92a7-44e2-a06f-14ebce735229 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:58.994906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590953de-0b08-468a-ba9b-fd424b22ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:58.996704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590953de-0b08-468a-ba9b-fd424b22ca3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:58.996975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590953de-0b08-468a-ba9b-fd424b22ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:58.997387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590953de-0b08-468a-ba9b-fd424b22ca3b admin admin] PATH_INFO: `/v3/projects/befbc77504b7420a8e272a84c64dd567/users/2fdaa1f2940549d2b597ae8290b1674c/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:59.018127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590953de-0b08-468a-ba9b-fd424b22ca3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=befbc77504b7420a8e272a84c64dd567, user_id=2fdaa1f2940549d2b597ae8290b1674c, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:59.024898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590953de-0b08-468a-ba9b-fd424b22ca3b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:59.162963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1186/2375] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:16:58 2022] PUT /identity/v3/projects/befbc77504b7420a8e272a84c64dd567/users/2fdaa1f2940549d2b597ae8290b1674c/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:16:59.164249 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e8b74-cd8b-4bec-b76a-dfa3cb6d968a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:59.164667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e8b74-cd8b-4bec-b76a-dfa3cb6d968a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:59.164953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e8b74-cd8b-4bec-b76a-dfa3cb6d968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:59.210665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-640e8b74-cd8b-4bec-b76a-dfa3cb6d968a None None] MFA Rules not processed for user `2fdaa1f2940549d2b597ae8290b1674c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:59.211938 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-640e8b74-cd8b-4bec-b76a-dfa3cb6d968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:59.289930 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049f4d0-d615-4cb2-977b-af832bf8897c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:59.290045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049f4d0-d615-4cb2-977b-af832bf8897c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:59.290276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049f4d0-d615-4cb2-977b-af832bf8897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:59.338832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a049f4d0-d615-4cb2-977b-af832bf8897c None None] MFA Rules not processed for user `c8e13f0777b244e39bb708bb9c2adfca`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:16:59.340702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a049f4d0-d615-4cb2-977b-af832bf8897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:59.355256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:59.362698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1190/2376] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:16:59.381773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e8b74-cd8b-4bec-b76a-dfa3cb6d968a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:59.383358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-640e8b74-cd8b-4bec-b76a-dfa3cb6d968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:59.439422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:16:59.468138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1187/2377] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:16:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:16:59.485362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049f4d0-d615-4cb2-977b-af832bf8897c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:16:59.487104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a049f4d0-d615-4cb2-977b-af832bf8897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:59.520267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e8b74-cd8b-4bec-b76a-dfa3cb6d968a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:59.533601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d108e-f13e-4e90-978b-740f08f8352d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:59.534706 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d108e-f13e-4e90-978b-740f08f8352d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:59.535167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d108e-f13e-4e90-978b-740f08f8352d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:59.537356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d108e-f13e-4e90-978b-740f08f8352d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:59.553448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d108e-f13e-4e90-978b-740f08f8352d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:59.555199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d108e-f13e-4e90-978b-740f08f8352d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:59.570685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1191/2378] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:16:59.675515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049f4d0-d615-4cb2-977b-af832bf8897c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:16:59.681655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:16:59.682315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:16:59.682595 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:16:59.683481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:16:59.685393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:16:59.788005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:16:59.789831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:16:59.801100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1188/2379] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:16:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:17:01.052945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241de8a-38cf-47be-8df4-052d362d3e55 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:01.053482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241de8a-38cf-47be-8df4-052d362d3e55 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:01.053706 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241de8a-38cf-47be-8df4-052d362d3e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:01.073094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6241de8a-38cf-47be-8df4-052d362d3e55 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:01.074295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6241de8a-38cf-47be-8df4-052d362d3e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:01.132662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1192/2380] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:17:01.186684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:01.188130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:01.202450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bb2f6-d472-4e3b-8ea6-d0d5f95f47af service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:01.207919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1aaac8-00cd-415a-b3ae-57e2125b3453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:01.208563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aaac8-00cd-415a-b3ae-57e2125b3453 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:01.208846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aaac8-00cd-415a-b3ae-57e2125b3453 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:01.209118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aaac8-00cd-415a-b3ae-57e2125b3453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:01.217798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1aaac8-00cd-415a-b3ae-57e2125b3453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:01.219455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1aaac8-00cd-415a-b3ae-57e2125b3453 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:01.229054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1189/2381] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:17:02.837217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754344a0-26e0-44ad-bb87-44939daad06e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:02.837217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754344a0-26e0-44ad-bb87-44939daad06e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:02.837217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754344a0-26e0-44ad-bb87-44939daad06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:02.855934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-754344a0-26e0-44ad-bb87-44939daad06e None None] MFA Rules not processed for user `7603d50657514c2d9e1ed22abccf972b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:02.857137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-754344a0-26e0-44ad-bb87-44939daad06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:02.864139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1193/2382] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:17:06.304263 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91e22d-f79a-4b52-bc8b-d2a574201e65 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:06.304963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91e22d-f79a-4b52-bc8b-d2a574201e65 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:06.305245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91e22d-f79a-4b52-bc8b-d2a574201e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:06.325762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3c91e22d-f79a-4b52-bc8b-d2a574201e65 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:06.327321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3c91e22d-f79a-4b52-bc8b-d2a574201e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:06.335401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1190/2383] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:17:06.354910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754344a0-26e0-44ad-bb87-44939daad06e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:06.369064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754344a0-26e0-44ad-bb87-44939daad06e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:06.375809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa32561-f1d2-486a-a992-ed9e247d99dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:06.379084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa32561-f1d2-486a-a992-ed9e247d99dd service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:06.379470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa32561-f1d2-486a-a992-ed9e247d99dd service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:06.379827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa32561-f1d2-486a-a992-ed9e247d99dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:06.390318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa32561-f1d2-486a-a992-ed9e247d99dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:06.391318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa32561-f1d2-486a-a992-ed9e247d99dd service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:06.401455 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1194/2384] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:17:11.017216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4a62b-4e6f-4f0a-9efd-022dda08fe98 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:11.017892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4a62b-4e6f-4f0a-9efd-022dda08fe98 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:11.017892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4a62b-4e6f-4f0a-9efd-022dda08fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:11.037230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3bf4a62b-4e6f-4f0a-9efd-022dda08fe98 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:11.038374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3bf4a62b-4e6f-4f0a-9efd-022dda08fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:11.047500 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1191/2385] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:17:11.076774 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa32561-f1d2-486a-a992-ed9e247d99dd service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:11.089573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa32561-f1d2-486a-a992-ed9e247d99dd service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:11.098146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12643d4-0c1c-4386-aaab-f1e3af112fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:11.098813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12643d4-0c1c-4386-aaab-f1e3af112fda service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:11.099104 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12643d4-0c1c-4386-aaab-f1e3af112fda service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:11.099382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12643d4-0c1c-4386-aaab-f1e3af112fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:11.113807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12643d4-0c1c-4386-aaab-f1e3af112fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:11.115562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12643d4-0c1c-4386-aaab-f1e3af112fda service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:11.126380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1195/2386] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:17:15.628684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4a62b-4e6f-4f0a-9efd-022dda08fe98 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:15.639649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4a62b-4e6f-4f0a-9efd-022dda08fe98 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:15.644541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:15.645463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:15.645743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:15.646013 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] PATH_INFO: `/v3/users/2fdaa1f2940549d2b597ae8290b1674c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:15.647193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fdaa1f2940549d2b597ae8290b1674c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:15.649168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:15.790109 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133130d-23ac-492a-bc3b-21b425a94a06 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:15.790607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133130d-23ac-492a-bc3b-21b425a94a06 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:15.790607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133130d-23ac-492a-bc3b-21b425a94a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:15.809125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6133130d-23ac-492a-bc3b-21b425a94a06 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:15.810386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6133130d-23ac-492a-bc3b-21b425a94a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:15.819062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1196/2387] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:17:15.824270 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:17:15.839477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fdaa1f2940549d2b597ae8290b1674c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:15.843333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133130d-23ac-492a-bc3b-21b425a94a06 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:15.854421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fdaa1f2940549d2b597ae8290b1674c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:15.856983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133130d-23ac-492a-bc3b-21b425a94a06 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:15.862995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647cb5f-44a6-421c-9e10-41053a364d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:15.874712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647cb5f-44a6-421c-9e10-41053a364d8d service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:15.874712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647cb5f-44a6-421c-9e10-41053a364d8d service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:15.874712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647cb5f-44a6-421c-9e10-41053a364d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:15.874712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647cb5f-44a6-421c-9e10-41053a364d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:15.874712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647cb5f-44a6-421c-9e10-41053a364d8d service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:15.884296 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1197/2388] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:17:15.983963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fdaa1f2940549d2b597ae8290b1674c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:15.984646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fdaa1f2940549d2b597ae8290b1674c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:15.997124 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fdaa1f2940549d2b597ae8290b1674c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:16.003198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1192/2389] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:17:15 2022] DELETE /identity/v3/users/2fdaa1f2940549d2b597ae8290b1674c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:17:16.007747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332a0b-41d3-4a8d-b8ac-ae80f9c796b2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:16.008094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332a0b-41d3-4a8d-b8ac-ae80f9c796b2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:16.008378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332a0b-41d3-4a8d-b8ac-ae80f9c796b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:16.027052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3b332a0b-41d3-4a8d-b8ac-ae80f9c796b2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:16.029625 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b332a0b-41d3-4a8d-b8ac-ae80f9c796b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:16.057812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:17:16.096131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1198/2390] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:17:16.111033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:16.112469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:16.173028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a88cc3-5b08-4235-9fc8-d388643e71d9 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:16.176712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793a850-fba3-41c9-ac21-2d89f45c133e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:16.177364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793a850-fba3-41c9-ac21-2d89f45c133e service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:16.177649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793a850-fba3-41c9-ac21-2d89f45c133e service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:16.177927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793a850-fba3-41c9-ac21-2d89f45c133e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:16.187763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793a850-fba3-41c9-ac21-2d89f45c133e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:16.189274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793a850-fba3-41c9-ac21-2d89f45c133e service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:16.198785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1193/2391] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:17:16.605469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b332a0b-41d3-4a8d-b8ac-ae80f9c796b2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:16.607030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b332a0b-41d3-4a8d-b8ac-ae80f9c796b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:16.623274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b332a0b-41d3-4a8d-b8ac-ae80f9c796b2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:16.627533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:16.628395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:16.628756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:16.628949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] PATH_INFO: `/v3/projects/befbc77504b7420a8e272a84c64dd567` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:16.630173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=befbc77504b7420a8e272a84c64dd567)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:16.632168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:16.745152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'befbc77504b7420a8e272a84c64dd567', 'request_id': 'req-f077d795-7747-4df3-8caa-705d798ce30a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:16.823727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'befbc77504b7420a8e272a84c64dd567', 'request_id': 'req-f077d795-7747-4df3-8caa-705d798ce30a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:16.831393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'befbc77504b7420a8e272a84c64dd567', 'request_id': 'req-f077d795-7747-4df3-8caa-705d798ce30a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:16.842167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] The token cache is being invalidate because project befbc77504b7420a8e272a84c64dd567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:17:16.842455 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:16.844043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:17:16.845654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1199/2392] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:17:16 2022] DELETE /identity/v3/projects/befbc77504b7420a8e272a84c64dd567 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:17:22.200515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bfd2c-bc2b-486f-a86b-60ece1dfa2c9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:22.200967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bfd2c-bc2b-486f-a86b-60ece1dfa2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:22.201139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bfd2c-bc2b-486f-a86b-60ece1dfa2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:22.219193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1f8bfd2c-bc2b-486f-a86b-60ece1dfa2c9 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:22.220459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1f8bfd2c-bc2b-486f-a86b-60ece1dfa2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:22.281008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1194/2393] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:17:22.318173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:22.320186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:22.396107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d795-7747-4df3-8caa-705d798ce30a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:22.401538 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e829c2-5863-4735-95a1-71045d151b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:22.402184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e829c2-5863-4735-95a1-71045d151b76 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:22.402466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e829c2-5863-4735-95a1-71045d151b76 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:22.402741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e829c2-5863-4735-95a1-71045d151b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:22.411954 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e829c2-5863-4735-95a1-71045d151b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:22.413556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e829c2-5863-4735-95a1-71045d151b76 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:22.424152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1200/2394] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:17:24.367877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d777b1e-ac65-41d5-89ed-452d4360fb38 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:24.368343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d777b1e-ac65-41d5-89ed-452d4360fb38 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:24.368465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d777b1e-ac65-41d5-89ed-452d4360fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:24.386831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8d777b1e-ac65-41d5-89ed-452d4360fb38 None None] MFA Rules not processed for user `4174d5226c454de9bd67dbce1aade939`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:24.388076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8d777b1e-ac65-41d5-89ed-452d4360fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:24.435175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:17:24.450760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1195/2395] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:17:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:17:26.565193 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e829c2-5863-4735-95a1-71045d151b76 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:26.566626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41e829c2-5863-4735-95a1-71045d151b76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:26.611051 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:17:26.662882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e829c2-5863-4735-95a1-71045d151b76 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:26.668448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:26.669084 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:26.669375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:26.669645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:26.672273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:26.684393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:26.685975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:26.695955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1201/2396] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:17:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:17:27.534350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39cdb0-a703-4f48-93b1-d171d53e674d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:27.534881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39cdb0-a703-4f48-93b1-d171d53e674d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:27.535004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39cdb0-a703-4f48-93b1-d171d53e674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:27.553105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4c39cdb0-a703-4f48-93b1-d171d53e674d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:27.554317 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4c39cdb0-a703-4f48-93b1-d171d53e674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:27.563238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1196/2397] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:17:27.585863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:27.587332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:27.602755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cdb14-cd11-4b8f-951e-fea962ae0aa8 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:27.608380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff7d42-abe5-4793-bf80-6077fb6ccb88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:27.609093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7d42-abe5-4793-bf80-6077fb6ccb88 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:27.609471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7d42-abe5-4793-bf80-6077fb6ccb88 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:27.609804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff7d42-abe5-4793-bf80-6077fb6ccb88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:27.618409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff7d42-abe5-4793-bf80-6077fb6ccb88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:27.620097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff7d42-abe5-4793-bf80-6077fb6ccb88 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:27.630995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1202/2398] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:17:37.547751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:17:37.627527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=29 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:17:55.544811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8ab7-519d-43c1-bc3b-be344347f54e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:55.545320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8ab7-519d-43c1-bc3b-be344347f54e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:55.545417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad8ab7-519d-43c1-bc3b-be344347f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:55.563144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1aad8ab7-519d-43c1-bc3b-be344347f54e None None] MFA Rules not processed for user `52c8ffa0e3b34d0cbb49aabb2c5ca75c`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:17:55.567585 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1aad8ab7-519d-43c1-bc3b-be344347f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:55.618277 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1197/2399] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:17:56.279972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff7d42-abe5-4793-bf80-6077fb6ccb88 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:17:56.281608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2dff7d42-abe5-4793-bf80-6077fb6ccb88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:56.350906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff7d42-abe5-4793-bf80-6077fb6ccb88 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:17:56.357549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1ea36-63b9-4b37-9bbe-ef277814f789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:17:56.357549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1ea36-63b9-4b37-9bbe-ef277814f789 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:17:56.357549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1ea36-63b9-4b37-9bbe-ef277814f789 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:17:56.357549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1ea36-63b9-4b37-9bbe-ef277814f789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:17:56.359328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1aa1ea36-63b9-4b37-9bbe-ef277814f789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:17:56.428745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1ea36-63b9-4b37-9bbe-ef277814f789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:17:56.430190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1ea36-63b9-4b37-9bbe-ef277814f789 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:17:56.441315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1203/2400] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:17:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:18:05.611137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=25 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:06.435970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=50 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:17.506059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d323809-837b-41e0-8917-9a291728311f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:17.506632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d323809-837b-41e0-8917-9a291728311f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:17.506632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d323809-837b-41e0-8917-9a291728311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:17.524552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5d323809-837b-41e0-8917-9a291728311f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:18:17.525763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5d323809-837b-41e0-8917-9a291728311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:18:17.533696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1198/2401] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:18:17.555237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1ea36-63b9-4b37-9bbe-ef277814f789 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:18:17.567638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1ea36-63b9-4b37-9bbe-ef277814f789 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:18:17.573216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53188065-ea21-4599-99f3-e7c0fb086ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:18:17.573852 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53188065-ea21-4599-99f3-e7c0fb086ffb service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:17.574143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53188065-ea21-4599-99f3-e7c0fb086ffb service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:17.574423 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53188065-ea21-4599-99f3-e7c0fb086ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:17.582527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53188065-ea21-4599-99f3-e7c0fb086ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:18:17.584403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53188065-ea21-4599-99f3-e7c0fb086ffb service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:18:17.593795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1204/2402] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:18:24.082313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898aec7c-2fe6-4f62-8f67-c75cc8b3744c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:24.082871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898aec7c-2fe6-4f62-8f67-c75cc8b3744c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:24.082987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898aec7c-2fe6-4f62-8f67-c75cc8b3744c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:24.101818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-898aec7c-2fe6-4f62-8f67-c75cc8b3744c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:18:24.103017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-898aec7c-2fe6-4f62-8f67-c75cc8b3744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:18:24.110832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1199/2403] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:18:24.141035 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53188065-ea21-4599-99f3-e7c0fb086ffb service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:18:24.152196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53188065-ea21-4599-99f3-e7c0fb086ffb service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:18:24.157663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b1617-f01a-4a4d-8443-a67201c94ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:18:24.158286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b1617-f01a-4a4d-8443-a67201c94ce4 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:24.158568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b1617-f01a-4a4d-8443-a67201c94ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:24.158842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b1617-f01a-4a4d-8443-a67201c94ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:24.167949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b1617-f01a-4a4d-8443-a67201c94ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:18:24.169675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b1617-f01a-4a4d-8443-a67201c94ce4 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:18:24.180280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1205/2404] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:18:28.042929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f246-4d2b-4fe2-b913-7598a3035b13 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:28.043421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f246-4d2b-4fe2-b913-7598a3035b13 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:28.043544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f246-4d2b-4fe2-b913-7598a3035b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:28.062037 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1107f246-4d2b-4fe2-b913-7598a3035b13 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:18:28.063237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1107f246-4d2b-4fe2-b913-7598a3035b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:18:28.071684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1200/2405] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:18:28.096443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b1617-f01a-4a4d-8443-a67201c94ce4 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:18:28.111856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b1617-f01a-4a4d-8443-a67201c94ce4 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:18:28.114053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952ecfa-4130-40cd-aa5a-057f89e3a83c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:18:28.114698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952ecfa-4130-40cd-aa5a-057f89e3a83c service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:28.114977 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952ecfa-4130-40cd-aa5a-057f89e3a83c service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:28.115259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952ecfa-4130-40cd-aa5a-057f89e3a83c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:28.123709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952ecfa-4130-40cd-aa5a-057f89e3a83c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:18:28.125335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952ecfa-4130-40cd-aa5a-057f89e3a83c service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:18:28.137277 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1206/2406] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:18:32.290322 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca699f-1809-4118-b633-466e42090777 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:32.290817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca699f-1809-4118-b633-466e42090777 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:32.290958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca699f-1809-4118-b633-466e42090777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:32.309682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3fca699f-1809-4118-b633-466e42090777 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:18:32.310861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3fca699f-1809-4118-b633-466e42090777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:18:32.318706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1201/2407] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:18:32.339971 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952ecfa-4130-40cd-aa5a-057f89e3a83c service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:18:32.351072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952ecfa-4130-40cd-aa5a-057f89e3a83c service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:18:32.356818 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cd93a-f7b5-4863-aaa3-bff0cca37015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:18:32.357446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd93a-f7b5-4863-aaa3-bff0cca37015 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:32.357728 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd93a-f7b5-4863-aaa3-bff0cca37015 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:32.358003 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cd93a-f7b5-4863-aaa3-bff0cca37015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:32.366333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cd93a-f7b5-4863-aaa3-bff0cca37015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:18:32.367898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cd93a-f7b5-4863-aaa3-bff0cca37015 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:18:32.378062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1207/2408] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:18:37.579631 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a186e04-f347-40a9-9de1-09a78b5361ac None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:37.580115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a186e04-f347-40a9-9de1-09a78b5361ac None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:37.580220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a186e04-f347-40a9-9de1-09a78b5361ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:37.598687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7a186e04-f347-40a9-9de1-09a78b5361ac None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:18:37.599910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7a186e04-f347-40a9-9de1-09a78b5361ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:18:37.607980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1202/2409] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jun 28 12:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:18:37.626717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cd93a-f7b5-4863-aaa3-bff0cca37015 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:18:37.638751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cd93a-f7b5-4863-aaa3-bff0cca37015 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:18:37.644166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3595-b2bb-405f-b86e-1c46b2d3030a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:18:37.644796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3595-b2bb-405f-b86e-1c46b2d3030a service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:37.645078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3595-b2bb-405f-b86e-1c46b2d3030a service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:37.645352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3595-b2bb-405f-b86e-1c46b2d3030a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:37.654248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3595-b2bb-405f-b86e-1c46b2d3030a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:18:37.655816 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3595-b2bb-405f-b86e-1c46b2d3030a service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:18:37.665263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1208/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:18:47.593599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=15 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:47.661014 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=30 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:18:53.417899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a3787-7415-4f79-8f5a-190fd1c4d74c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:18:53.418262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a3787-7415-4f79-8f5a-190fd1c4d74c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:18:53.418476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a3787-7415-4f79-8f5a-190fd1c4d74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:18:53.436565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d69a3787-7415-4f79-8f5a-190fd1c4d74c None None] MFA Rules not processed for user `cc3cfbaa95774ccbb567374a99e2b25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:18:53.437848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d69a3787-7415-4f79-8f5a-190fd1c4d74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:18:53.491191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1203/2411] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:18:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:19:03.484763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=25 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:07.505032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3595-b2bb-405f-b86e-1c46b2d3030a service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:07.507978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-18af3595-b2bb-405f-b86e-1c46b2d3030a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:07.566607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3595-b2bb-405f-b86e-1c46b2d3030a service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:07.570229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1cdf-9141-46fe-8c60-d28b7cc2cf92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:07.570871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1cdf-9141-46fe-8c60-d28b7cc2cf92 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:07.571176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1cdf-9141-46fe-8c60-d28b7cc2cf92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:07.571438 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1cdf-9141-46fe-8c60-d28b7cc2cf92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:07.573277 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e18d1cdf-9141-46fe-8c60-d28b7cc2cf92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:07.587108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d1cdf-9141-46fe-8c60-d28b7cc2cf92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:07.588593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d1cdf-9141-46fe-8c60-d28b7cc2cf92 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:07.600135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1209/2412] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:11.624166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a3787-7415-4f79-8f5a-190fd1c4d74c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:11.634231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a3787-7415-4f79-8f5a-190fd1c4d74c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:11.637833 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1c2f8-9a66-4137-879c-12f0a96ca820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:11.639527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c2f8-9a66-4137-879c-12f0a96ca820 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:11.639527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c2f8-9a66-4137-879c-12f0a96ca820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:11.639527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c2f8-9a66-4137-879c-12f0a96ca820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:11.640864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-90d1c2f8-9a66-4137-879c-12f0a96ca820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:11.654773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1c2f8-9a66-4137-879c-12f0a96ca820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:11.656660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1c2f8-9a66-4137-879c-12f0a96ca820 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:11.667730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1204/2413] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:16.026049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeef277-1c54-44fa-9286-f3b122b3dfdc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:16.026651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeef277-1c54-44fa-9286-f3b122b3dfdc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:16.026651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeef277-1c54-44fa-9286-f3b122b3dfdc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:16.028018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1210/2414] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 12:19:16.036379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598938d-e928-40f5-8f11-f16830927199 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:16.060905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598938d-e928-40f5-8f11-f16830927199 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:16.060905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598938d-e928-40f5-8f11-f16830927199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:16.089055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5598938d-e928-40f5-8f11-f16830927199 None None] MFA Rules not processed for user `c7db581dec064fe0afeb4be5838470bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:19:16.090381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5598938d-e928-40f5-8f11-f16830927199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:16.100237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1205/2415] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:19:16.111826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeef277-1c54-44fa-9286-f3b122b3dfdc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:16.113590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9aeef277-1c54-44fa-9286-f3b122b3dfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:16.130848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeef277-1c54-44fa-9286-f3b122b3dfdc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:16.135821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeece2c1-d1dd-40d8-b019-a235e3cad33f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:16.136475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeece2c1-d1dd-40d8-b019-a235e3cad33f service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:16.136756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeece2c1-d1dd-40d8-b019-a235e3cad33f service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:16.137031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeece2c1-d1dd-40d8-b019-a235e3cad33f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:16.145637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeece2c1-d1dd-40d8-b019-a235e3cad33f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:16.147234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeece2c1-d1dd-40d8-b019-a235e3cad33f service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:16.157018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1211/2416] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:16.191419 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598938d-e928-40f5-8f11-f16830927199 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:16.192871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5598938d-e928-40f5-8f11-f16830927199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:16.210071 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598938d-e928-40f5-8f11-f16830927199 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:16.214655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:16.218687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:16.218687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:16.218687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] PATH_INFO: `/v3/users/52c8ffa0e3b34d0cbb49aabb2c5ca75c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:16.218687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c8ffa0e3b34d0cbb49aabb2c5ca75c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:16.219174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:16.445895 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c8ffa0e3b34d0cbb49aabb2c5ca75c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:16.453296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c8ffa0e3b34d0cbb49aabb2c5ca75c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:16.535054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c8ffa0e3b34d0cbb49aabb2c5ca75c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:16.535691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c8ffa0e3b34d0cbb49aabb2c5ca75c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:16.548203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-cdc8589b-8394-4642-8b99-881f73bcd917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c8ffa0e3b34d0cbb49aabb2c5ca75c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:16.554004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1206/2417] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:19:16 2022] DELETE /identity/v3/users/52c8ffa0e3b34d0cbb49aabb2c5ca75c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:19:16.821023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeece2c1-d1dd-40d8-b019-a235e3cad33f service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:16.833306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeece2c1-d1dd-40d8-b019-a235e3cad33f service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:16.889838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:16.890689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:16.890969 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:16.891243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] PATH_INFO: `/v3/projects/5cab415784f4416eb683a82847963410` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:16.893120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cab415784f4416eb683a82847963410)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:16.895108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:17.003330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cab415784f4416eb683a82847963410', 'request_id': 'req-449240b8-3ddc-4150-9e6d-34421e4251de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:17.077113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cab415784f4416eb683a82847963410', 'request_id': 'req-449240b8-3ddc-4150-9e6d-34421e4251de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:17.084290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cab415784f4416eb683a82847963410', 'request_id': 'req-449240b8-3ddc-4150-9e6d-34421e4251de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:17.094952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] The token cache is being invalidate because project 5cab415784f4416eb683a82847963410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:19:17.095276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:17.096414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-449240b8-3ddc-4150-9e6d-34421e4251de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:17.098022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1212/2418] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:19:16 2022] DELETE /identity/v3/projects/5cab415784f4416eb683a82847963410 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:19:17.103005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7ceef-1e56-4b16-afa9-995ff8132551 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.103455 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7ceef-1e56-4b16-afa9-995ff8132551 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.103576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7ceef-1e56-4b16-afa9-995ff8132551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.122426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-22a7ceef-1e56-4b16-afa9-995ff8132551 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:19:17.123649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-22a7ceef-1e56-4b16-afa9-995ff8132551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:17.182340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1207/2419] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:19:17.190574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0651a-ea96-4daf-9c5b-f1f5febfb6ae None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.190857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0651a-ea96-4daf-9c5b-f1f5febfb6ae None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.191134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0651a-ea96-4daf-9c5b-f1f5febfb6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.209086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-edb0651a-ea96-4daf-9c5b-f1f5febfb6ae None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:19:17.210292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-edb0651a-ea96-4daf-9c5b-f1f5febfb6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:17.218108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1213/2420] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:19:17.222289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7ceef-1e56-4b16-afa9-995ff8132551 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:17.231763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7ceef-1e56-4b16-afa9-995ff8132551 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:17.236763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d62fd-8116-407d-a279-ce7a20604d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:17.237408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d62fd-8116-407d-a279-ce7a20604d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.237687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d62fd-8116-407d-a279-ce7a20604d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.237957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d62fd-8116-407d-a279-ce7a20604d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.238672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d62fd-8116-407d-a279-ce7a20604d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:19:17.239002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d62fd-8116-407d-a279-ce7a20604d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:17.240630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d62fd-8116-407d-a279-ce7a20604d7e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:17.252575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1208/2421] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:19:17.256898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0651a-ea96-4daf-9c5b-f1f5febfb6ae None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:17.265991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0651a-ea96-4daf-9c5b-f1f5febfb6ae None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:17.271400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef5092-6185-4b32-b73d-85c4ff19ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:17.272095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef5092-6185-4b32-b73d-85c4ff19ef90 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.272378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef5092-6185-4b32-b73d-85c4ff19ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.272655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef5092-6185-4b32-b73d-85c4ff19ef90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.273350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef5092-6185-4b32-b73d-85c4ff19ef90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:17.275248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef5092-6185-4b32-b73d-85c4ff19ef90 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:17.285110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:17.353637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1214/2422] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:19:17 2022] POST /identity/v3/projects => generated 395 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:19:17.357356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d62fd-8116-407d-a279-ce7a20604d7e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:17.368682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d62fd-8116-407d-a279-ce7a20604d7e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:17.394167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:17.424889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104a016-7fdd-4836-a5a5-13f4cbe81dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:17.425576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104a016-7fdd-4836-a5a5-13f4cbe81dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.425857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104a016-7fdd-4836-a5a5-13f4cbe81dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.426133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104a016-7fdd-4836-a5a5-13f4cbe81dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.426811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104a016-7fdd-4836-a5a5-13f4cbe81dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:17.428761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104a016-7fdd-4836-a5a5-13f4cbe81dd8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:17.464576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef5092-6185-4b32-b73d-85c4ff19ef90 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:17.466301 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bdef5092-6185-4b32-b73d-85c4ff19ef90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:17.498229 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1209/2423] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:19:17 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:19:17.499444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104a016-7fdd-4836-a5a5-13f4cbe81dd8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:17.510471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104a016-7fdd-4836-a5a5-13f4cbe81dd8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:17.515105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ef506-5099-4b9b-ba14-79de469cc452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:17.515762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ef506-5099-4b9b-ba14-79de469cc452 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.516076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ef506-5099-4b9b-ba14-79de469cc452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.516360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ef506-5099-4b9b-ba14-79de469cc452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.517092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ef506-5099-4b9b-ba14-79de469cc452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:17.518706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ef506-5099-4b9b-ba14-79de469cc452 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:17.529642 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1210/2424] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:19:17.540268 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ef506-5099-4b9b-ba14-79de469cc452 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:17.549368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef5092-6185-4b32-b73d-85c4ff19ef90 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:17.552135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ef506-5099-4b9b-ba14-79de469cc452 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:17.555672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f5b21-7c94-47a7-8091-63871084d1d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:17.556354 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f5b21-7c94-47a7-8091-63871084d1d4 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.556640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f5b21-7c94-47a7-8091-63871084d1d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.556917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f5b21-7c94-47a7-8091-63871084d1d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.557832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee2b1d-c6f7-47e3-9865-3f318bbc015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:17.558484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee2b1d-c6f7-47e3-9865-3f318bbc015a admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.558722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e03f5b21-7c94-47a7-8091-63871084d1d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:17.558828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee2b1d-c6f7-47e3-9865-3f318bbc015a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.559030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee2b1d-c6f7-47e3-9865-3f318bbc015a admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.559814 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee2b1d-c6f7-47e3-9865-3f318bbc015a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:17.561387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee2b1d-c6f7-47e3-9865-3f318bbc015a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:17.571464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1211/2425] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:19:17.575510 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee2b1d-c6f7-47e3-9865-3f318bbc015a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:17.585085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee2b1d-c6f7-47e3-9865-3f318bbc015a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:17.589671 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c884d26-286b-442b-a529-96dc4c0133cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:17.590530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c884d26-286b-442b-a529-96dc4c0133cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.594648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c884d26-286b-442b-a529-96dc4c0133cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.594648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c884d26-286b-442b-a529-96dc4c0133cf admin admin] PATH_INFO: `/v3/projects/b4ac86a39a8940c98db8c2905e632a2c/users/0c85a53dd7244e3285f14f2515801d56/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.606349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c884d26-286b-442b-a529-96dc4c0133cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ac86a39a8940c98db8c2905e632a2c, user_id=0c85a53dd7244e3285f14f2515801d56, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:17.609057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c884d26-286b-442b-a529-96dc4c0133cf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:17.620673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f5b21-7c94-47a7-8091-63871084d1d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:17.623053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f5b21-7c94-47a7-8091-63871084d1d4 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:17.631497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1215/2426] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:19:17.678551 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1212/2427] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:19:17 2022] PUT /identity/v3/projects/b4ac86a39a8940c98db8c2905e632a2c/users/0c85a53dd7244e3285f14f2515801d56/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:19:17.689252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe0d0-8cfb-4a7e-8c5c-15427db9831f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.689549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe0d0-8cfb-4a7e-8c5c-15427db9831f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.689913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe0d0-8cfb-4a7e-8c5c-15427db9831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.716332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fbffe0d0-8cfb-4a7e-8c5c-15427db9831f None None] MFA Rules not processed for user `0c85a53dd7244e3285f14f2515801d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:19:17.717546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fbffe0d0-8cfb-4a7e-8c5c-15427db9831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:17.782357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1216/2428] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:19:17.794598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c884d26-286b-442b-a529-96dc4c0133cf admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:17.796547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4c884d26-286b-442b-a529-96dc4c0133cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:17.855230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c884d26-286b-442b-a529-96dc4c0133cf admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:17.858863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cff28a-2ce2-4bc9-b3b5-5762ef912e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:17.859496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cff28a-2ce2-4bc9-b3b5-5762ef912e6c service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:17.859776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cff28a-2ce2-4bc9-b3b5-5762ef912e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:17.860084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cff28a-2ce2-4bc9-b3b5-5762ef912e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:17.868883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cff28a-2ce2-4bc9-b3b5-5762ef912e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:17.870300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cff28a-2ce2-4bc9-b3b5-5762ef912e6c service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:17.878863 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1213/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:24.725819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffe0d0-8cfb-4a7e-8c5c-15427db9831f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:24.744252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:24.788984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffe0d0-8cfb-4a7e-8c5c-15427db9831f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:24.794096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:24.795049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:24.795333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:24.795643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] PATH_INFO: `/v3/users/0c85a53dd7244e3285f14f2515801d56` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:24.797177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c85a53dd7244e3285f14f2515801d56)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:24.799485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:24.961870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c85a53dd7244e3285f14f2515801d56'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:24.969248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c85a53dd7244e3285f14f2515801d56'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:24.969729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c85a53dd7244e3285f14f2515801d56'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:24.982024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c85a53dd7244e3285f14f2515801d56'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:25.048606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c85a53dd7244e3285f14f2515801d56'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:25.056147 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1217/2430] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:19:24 2022] DELETE /identity/v3/users/0c85a53dd7244e3285f14f2515801d56 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:19:25.065689 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15231bb5-ad9e-4f14-8f2b-b806f55b9293 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:25.066258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15231bb5-ad9e-4f14-8f2b-b806f55b9293 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:25.066562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15231bb5-ad9e-4f14-8f2b-b806f55b9293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:25.083636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-15231bb5-ad9e-4f14-8f2b-b806f55b9293 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:19:25.084877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-15231bb5-ad9e-4f14-8f2b-b806f55b9293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:25.144572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1214/2431] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:19:25.154102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:25.155486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:25.211859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad640214-0168-42db-bbd0-53903e0de691 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:25.215645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f63c6-2c91-42e6-8b2f-3752aba9a7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:25.216264 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f63c6-2c91-42e6-8b2f-3752aba9a7cb service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:25.216548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f63c6-2c91-42e6-8b2f-3752aba9a7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:25.216825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f63c6-2c91-42e6-8b2f-3752aba9a7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:25.226399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f63c6-2c91-42e6-8b2f-3752aba9a7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:25.227824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f63c6-2c91-42e6-8b2f-3752aba9a7cb service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:25.237321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1218/2432] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:25.592747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15231bb5-ad9e-4f14-8f2b-b806f55b9293 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:25.595282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-15231bb5-ad9e-4f14-8f2b-b806f55b9293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:25.606232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15231bb5-ad9e-4f14-8f2b-b806f55b9293 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:25.610876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:25.611779 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:25.612091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:25.612910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] PATH_INFO: `/v3/projects/b4ac86a39a8940c98db8c2905e632a2c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:25.614485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ac86a39a8940c98db8c2905e632a2c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:25.616512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:25.625067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:25.752117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ac86a39a8940c98db8c2905e632a2c', 'request_id': 'req-c52e96dd-c64d-4e7c-b790-b9c134645941'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:25.758953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ac86a39a8940c98db8c2905e632a2c', 'request_id': 'req-c52e96dd-c64d-4e7c-b790-b9c134645941'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:25.765205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ac86a39a8940c98db8c2905e632a2c', 'request_id': 'req-c52e96dd-c64d-4e7c-b790-b9c134645941'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:25.848758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] The token cache is being invalidate because project b4ac86a39a8940c98db8c2905e632a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:19:25.849050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:25.849759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:19:25.851321 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1215/2433] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:19:25 2022] DELETE /identity/v3/projects/b4ac86a39a8940c98db8c2905e632a2c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:19:29.995055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f63c6-2c91-42e6-8b2f-3752aba9a7cb service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:29.996615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f58f63c6-2c91-42e6-8b2f-3752aba9a7cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:30.040079 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:30.071474 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f63c6-2c91-42e6-8b2f-3752aba9a7cb service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:30.136955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3c006-05b6-4f2a-9470-c7f2618a872e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:30.137606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3c006-05b6-4f2a-9470-c7f2618a872e service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:30.137889 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3c006-05b6-4f2a-9470-c7f2618a872e service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:30.138165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3c006-05b6-4f2a-9470-c7f2618a872e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:30.140113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-62c3c006-05b6-4f2a-9470-c7f2618a872e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:30.200495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3c006-05b6-4f2a-9470-c7f2618a872e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:30.202137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3c006-05b6-4f2a-9470-c7f2618a872e service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:30.211411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1219/2434] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:35.844998 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:40.207108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=66 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:19:42.116156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:42.116156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:42.131790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e96dd-c64d-4e7c-b790-b9c134645941 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:42.137368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:42.138020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:42.138304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:42.138583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:42.140427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:42.153074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:42.154713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:42.167727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1216/2435] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:47.004054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab4a8-77c9-4ab9-a0c1-70ec53f67f77 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:47.004623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab4a8-77c9-4ab9-a0c1-70ec53f67f77 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:47.004623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab4a8-77c9-4ab9-a0c1-70ec53f67f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:47.022205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-756ab4a8-77c9-4ab9-a0c1-70ec53f67f77 None None] MFA Rules not processed for user `4174d5226c454de9bd67dbce1aade939`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:19:47.024718 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-756ab4a8-77c9-4ab9-a0c1-70ec53f67f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:47.031548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1220/2436] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:19:47.330005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:47.331379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:47.386439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587240-107c-43c5-8612-2442e863b3a7 service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:47.390002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05099b3a-c59f-4025-b1bf-fb0980c96dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:47.390638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099b3a-c59f-4025-b1bf-fb0980c96dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:47.390918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099b3a-c59f-4025-b1bf-fb0980c96dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:47.391191 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05099b3a-c59f-4025-b1bf-fb0980c96dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:47.392948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-05099b3a-c59f-4025-b1bf-fb0980c96dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:47.402233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05099b3a-c59f-4025-b1bf-fb0980c96dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:47.403647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05099b3a-c59f-4025-b1bf-fb0980c96dc3 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:47.411410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1217/2437] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:47.789482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab4a8-77c9-4ab9-a0c1-70ec53f67f77 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:47.791488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-756ab4a8-77c9-4ab9-a0c1-70ec53f67f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:47.865490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab4a8-77c9-4ab9-a0c1-70ec53f67f77 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:47.871004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057cfbf-808d-43ac-96bf-57ef32208fb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:47.871653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057cfbf-808d-43ac-96bf-57ef32208fb2 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:47.871974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057cfbf-808d-43ac-96bf-57ef32208fb2 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:47.872257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057cfbf-808d-43ac-96bf-57ef32208fb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:47.874064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6057cfbf-808d-43ac-96bf-57ef32208fb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:47.885723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057cfbf-808d-43ac-96bf-57ef32208fb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:47.887297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057cfbf-808d-43ac-96bf-57ef32208fb2 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:47.897132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1221/2438] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:50.850755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05099b3a-c59f-4025-b1bf-fb0980c96dc3 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:50.860654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05099b3a-c59f-4025-b1bf-fb0980c96dc3 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:50.863633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:50.864316 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:50.864605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:50.864883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:50.866675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:50.876991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:50.878424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:50.887204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1218/2439] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:19:57.883291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057cfbf-808d-43ac-96bf-57ef32208fb2 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:19:57.896553 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057cfbf-808d-43ac-96bf-57ef32208fb2 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:19:57.903324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:19:57.904065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:19:57.904356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:19:57.904637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:19:57.906470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:19:57.919278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:19:57.920885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:19:57.932324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1222/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:19:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:20:00.882898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=38 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:06.110264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:06.111706 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:06.168100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112741e6-6413-416b-8fff-b06d798a68be service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:06.171678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:06.172356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:06.172642 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:06.172917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:06.174721 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:06.233958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:06.235633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:06.245367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1219/2441] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:20:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:20:07.927070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=41 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:16.240488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=48 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:27.084118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:27.085543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:27.097424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186f85-e74e-4ea2-923e-3a3eb9417e06 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:27.101016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334299-4a08-4a8b-a5ec-51af82c5ab79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:27.101643 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334299-4a08-4a8b-a5ec-51af82c5ab79 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:27.101923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334299-4a08-4a8b-a5ec-51af82c5ab79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:27.102197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334299-4a08-4a8b-a5ec-51af82c5ab79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:27.103972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4f334299-4a08-4a8b-a5ec-51af82c5ab79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:27.166223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f334299-4a08-4a8b-a5ec-51af82c5ab79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:27.167657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f334299-4a08-4a8b-a5ec-51af82c5ab79 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:27.177891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1223/2442] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:20:30.801160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:30.802734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:30.821653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b134cd1-2f0a-4dbd-af02-a47d1c62db2e service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:30.826247 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:30.827120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:30.827422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:30.828250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] PATH_INFO: `/v3/users/cc3cfbaa95774ccbb567374a99e2b25b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:30.829487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3cfbaa95774ccbb567374a99e2b25b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:30.831425 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:30.957805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3cfbaa95774ccbb567374a99e2b25b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:30.964647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3cfbaa95774ccbb567374a99e2b25b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:31.012826 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3cfbaa95774ccbb567374a99e2b25b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:31.013447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3cfbaa95774ccbb567374a99e2b25b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:31.025436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-31612c1e-9a8a-4fe9-ac94-e4cb769012fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3cfbaa95774ccbb567374a99e2b25b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:31.032310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1220/2443] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:20:30 2022] DELETE /identity/v3/users/cc3cfbaa95774ccbb567374a99e2b25b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:20:31.271989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334299-4a08-4a8b-a5ec-51af82c5ab79 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:31.284320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334299-4a08-4a8b-a5ec-51af82c5ab79 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:31.345135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:31.346002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:31.346287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:31.346564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] PATH_INFO: `/v3/projects/5af30325ad8e4d90a334078ff2a94db3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:31.347832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af30325ad8e4d90a334078ff2a94db3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:31.349812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:31.447859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af30325ad8e4d90a334078ff2a94db3', 'request_id': 'req-2ab15956-03ff-4741-90d4-e116afb39e72'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:31.493217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af30325ad8e4d90a334078ff2a94db3', 'request_id': 'req-2ab15956-03ff-4741-90d4-e116afb39e72'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:31.499632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af30325ad8e4d90a334078ff2a94db3', 'request_id': 'req-2ab15956-03ff-4741-90d4-e116afb39e72'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:31.510466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] The token cache is being invalidate because project 5af30325ad8e4d90a334078ff2a94db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:20:31.510751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:31.511485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ab15956-03ff-4741-90d4-e116afb39e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:20:31.513002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1224/2444] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:20:31 2022] DELETE /identity/v3/projects/5af30325ad8e4d90a334078ff2a94db3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:20:31.518715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ee64-3a9c-490b-a36e-4fa0917b231e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:31.518944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ee64-3a9c-490b-a36e-4fa0917b231e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:31.519222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5ee64-3a9c-490b-a36e-4fa0917b231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:31.537259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-61f5ee64-3a9c-490b-a36e-4fa0917b231e None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:20:31.538448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-61f5ee64-3a9c-490b-a36e-4fa0917b231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:31.597544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1221/2445] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:20:31.604964 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a39af1-b7d9-4ee5-897d-881066940d7c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:31.605254 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a39af1-b7d9-4ee5-897d-881066940d7c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:31.605532 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a39af1-b7d9-4ee5-897d-881066940d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:31.623220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-95a39af1-b7d9-4ee5-897d-881066940d7c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:20:31.624456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-95a39af1-b7d9-4ee5-897d-881066940d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:31.632555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1225/2446] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:20:31.636717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ee64-3a9c-490b-a36e-4fa0917b231e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:31.646832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5ee64-3a9c-490b-a36e-4fa0917b231e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:31.651367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5da5-aabc-4349-9594-31fa03058af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:31.652057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5da5-aabc-4349-9594-31fa03058af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:31.652341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5da5-aabc-4349-9594-31fa03058af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:31.652616 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5da5-aabc-4349-9594-31fa03058af7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:31.653336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5da5-aabc-4349-9594-31fa03058af7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:20:31.653644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5da5-aabc-4349-9594-31fa03058af7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:31.655244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5da5-aabc-4349-9594-31fa03058af7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:31.666676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1222/2447] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:20:31.670721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a39af1-b7d9-4ee5-897d-881066940d7c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:31.680948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a39af1-b7d9-4ee5-897d-881066940d7c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:31.685633 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304768a-8795-42c9-96f0-eee4e97eee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:31.686273 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304768a-8795-42c9-96f0-eee4e97eee88 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:31.686560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304768a-8795-42c9-96f0-eee4e97eee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:31.687524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304768a-8795-42c9-96f0-eee4e97eee88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:31.688257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304768a-8795-42c9-96f0-eee4e97eee88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:31.690158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304768a-8795-42c9-96f0-eee4e97eee88 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:31.703394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:31.769492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1226/2448] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:20:31 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:20:31.773575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5da5-aabc-4349-9594-31fa03058af7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:31.784075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5da5-aabc-4349-9594-31fa03058af7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:31.839632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feba815-605c-48cf-b471-f485d5bdae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:31.840325 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feba815-605c-48cf-b471-f485d5bdae60 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:31.840591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feba815-605c-48cf-b471-f485d5bdae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:31.840861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feba815-605c-48cf-b471-f485d5bdae60 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:31.841540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feba815-605c-48cf-b471-f485d5bdae60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:31.844047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feba815-605c-48cf-b471-f485d5bdae60 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:31.850582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:31.932588 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1223/2449] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:20:31 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:20:31.936975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304768a-8795-42c9-96f0-eee4e97eee88 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:31.947525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304768a-8795-42c9-96f0-eee4e97eee88 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:31.952596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf3994-2670-4bc2-8449-2612a1ac6fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:31.953219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf3994-2670-4bc2-8449-2612a1ac6fce admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:31.953595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf3994-2670-4bc2-8449-2612a1ac6fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:31.953871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf3994-2670-4bc2-8449-2612a1ac6fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:31.954637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf3994-2670-4bc2-8449-2612a1ac6fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:31.956298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf3994-2670-4bc2-8449-2612a1ac6fce admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:31.966112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1227/2450] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:20:31.970707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feba815-605c-48cf-b471-f485d5bdae60 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:31.980463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feba815-605c-48cf-b471-f485d5bdae60 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:31.985895 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877efa0-4bc8-4571-8a35-d65ba5a0a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:31.986543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877efa0-4bc8-4571-8a35-d65ba5a0a939 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:31.986824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877efa0-4bc8-4571-8a35-d65ba5a0a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:31.987099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877efa0-4bc8-4571-8a35-d65ba5a0a939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:31.988054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877efa0-4bc8-4571-8a35-d65ba5a0a939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:31.989645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877efa0-4bc8-4571-8a35-d65ba5a0a939 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:32.000778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1224/2451] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:20:32.004709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf3994-2670-4bc2-8449-2612a1ac6fce admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:32.014458 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf3994-2670-4bc2-8449-2612a1ac6fce admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:32.019006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca73ea-6fab-41c6-bf16-c5768b9315b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:32.019939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca73ea-6fab-41c6-bf16-c5768b9315b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:32.020184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca73ea-6fab-41c6-bf16-c5768b9315b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:32.020477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca73ea-6fab-41c6-bf16-c5768b9315b3 admin admin] PATH_INFO: `/v3/projects/bdd40a85f0284703ad395e91912991d7/users/e95a1f9496564c2783c228929fdbcb32/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:32.035313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca73ea-6fab-41c6-bf16-c5768b9315b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd40a85f0284703ad395e91912991d7, user_id=e95a1f9496564c2783c228929fdbcb32, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:32.037982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca73ea-6fab-41c6-bf16-c5768b9315b3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:32.139178 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1228/2452] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:20:32 2022] PUT /identity/v3/projects/bdd40a85f0284703ad395e91912991d7/users/e95a1f9496564c2783c228929fdbcb32/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:20:32.145252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c02261-088b-43b4-a971-49ba28ff82e7 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:32.145641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c02261-088b-43b4-a971-49ba28ff82e7 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:32.145921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c02261-088b-43b4-a971-49ba28ff82e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:32.163773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-18c02261-088b-43b4-a971-49ba28ff82e7 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:20:32.165002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-18c02261-088b-43b4-a971-49ba28ff82e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:32.224082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1225/2453] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:20:32.233474 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca73ea-6fab-41c6-bf16-c5768b9315b3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:32.235383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-90ca73ea-6fab-41c6-bf16-c5768b9315b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:32.292597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca73ea-6fab-41c6-bf16-c5768b9315b3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:32.296742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee311b-c7ff-4017-ba7d-2398a6239eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:32.297364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee311b-c7ff-4017-ba7d-2398a6239eed service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:32.297648 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee311b-c7ff-4017-ba7d-2398a6239eed service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:32.297925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee311b-c7ff-4017-ba7d-2398a6239eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:32.307005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee311b-c7ff-4017-ba7d-2398a6239eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:32.308477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee311b-c7ff-4017-ba7d-2398a6239eed service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:32.318554 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1229/2454] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:20:37.625665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097e14-e01b-4427-9275-9cdccb6b7a57 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:37.626174 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097e14-e01b-4427-9275-9cdccb6b7a57 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:37.626388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097e14-e01b-4427-9275-9cdccb6b7a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:37.665953 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-69097e14-e01b-4427-9275-9cdccb6b7a57 None None] MFA Rules not processed for user `e95a1f9496564c2783c228929fdbcb32`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:20:37.667276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-69097e14-e01b-4427-9275-9cdccb6b7a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:37.741864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1226/2455] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:20:37.761874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee311b-c7ff-4017-ba7d-2398a6239eed service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:37.764119 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c8ee311b-c7ff-4017-ba7d-2398a6239eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:37.851527 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee311b-c7ff-4017-ba7d-2398a6239eed service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:37.861568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a67f9e-82be-429c-bf5f-3e1d26c4160d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:37.862383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a67f9e-82be-429c-bf5f-3e1d26c4160d service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:37.862789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a67f9e-82be-429c-bf5f-3e1d26c4160d service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:37.863165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a67f9e-82be-429c-bf5f-3e1d26c4160d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:37.872655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a67f9e-82be-429c-bf5f-3e1d26c4160d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:37.875059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a67f9e-82be-429c-bf5f-3e1d26c4160d service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:37.885651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1230/2456] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:20:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:20:40.423946 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6959f2-2327-4e9b-9839-2a796d2b379c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:40.424499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6959f2-2327-4e9b-9839-2a796d2b379c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:40.425050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6959f2-2327-4e9b-9839-2a796d2b379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:40.444857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4b6959f2-2327-4e9b-9839-2a796d2b379c None None] MFA Rules not processed for user `e95a1f9496564c2783c228929fdbcb32`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:20:40.446346 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4b6959f2-2327-4e9b-9839-2a796d2b379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:40.455144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1227/2457] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:20:43.158369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64841eab-b10a-435e-8571-50ef7284d769 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:43.158854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64841eab-b10a-435e-8571-50ef7284d769 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:43.160161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64841eab-b10a-435e-8571-50ef7284d769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:43.177099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-64841eab-b10a-435e-8571-50ef7284d769 None None] MFA Rules not processed for user `41b13986fd754f0283047ddf865a19de`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:20:43.179153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-64841eab-b10a-435e-8571-50ef7284d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:43.218236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:43.240432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1231/2458] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:20:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:20:43.852224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6959f2-2327-4e9b-9839-2a796d2b379c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:20:43.853727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4b6959f2-2327-4e9b-9839-2a796d2b379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:43.866214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6959f2-2327-4e9b-9839-2a796d2b379c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:20:43.869800 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2274774-1e22-4f81-9cd1-5653ef414fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:20:43.870435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2274774-1e22-4f81-9cd1-5653ef414fce service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:20:43.870718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2274774-1e22-4f81-9cd1-5653ef414fce service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:20:43.870999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2274774-1e22-4f81-9cd1-5653ef414fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:20:43.872811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e2274774-1e22-4f81-9cd1-5653ef414fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:20:43.882617 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2274774-1e22-4f81-9cd1-5653ef414fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:20:43.884077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2274774-1e22-4f81-9cd1-5653ef414fce service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:20:43.892183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1228/2459] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:20:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:20:53.281905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:20:53.888442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:INSERT=3,keystone:SELECT=75 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:21:00.526518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64841eab-b10a-435e-8571-50ef7284d769 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:21:00.541355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64841eab-b10a-435e-8571-50ef7284d769 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:21:00.550590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da075dc-88de-46aa-8eac-71bf63b1023e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:21:00.551360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da075dc-88de-46aa-8eac-71bf63b1023e service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:21:00.552191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da075dc-88de-46aa-8eac-71bf63b1023e service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:21:00.552482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da075dc-88de-46aa-8eac-71bf63b1023e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:21:00.555149 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3da075dc-88de-46aa-8eac-71bf63b1023e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:21:00.571708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da075dc-88de-46aa-8eac-71bf63b1023e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:21:00.573335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da075dc-88de-46aa-8eac-71bf63b1023e service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:21:00.585640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1232/2460] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:21:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:21:10.581066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:21:11.325056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4a5f3-1daf-4a9b-9614-8e9dce21f3c2 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:21:11.325579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4a5f3-1daf-4a9b-9614-8e9dce21f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:21:11.325678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4a5f3-1daf-4a9b-9614-8e9dce21f3c2 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:21:11.327015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1229/2461] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:21:11.333093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aae8d-2afe-4174-b594-13b633af076a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:21:11.333383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aae8d-2afe-4174-b594-13b633af076a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:21:11.333668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aae8d-2afe-4174-b594-13b633af076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:21:11.351815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-832aae8d-2afe-4174-b594-13b633af076a None None] MFA Rules not processed for user `3ff61c1fbdf34fa38588e4cd2cdc5398`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:21:11.353058 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-832aae8d-2afe-4174-b594-13b633af076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:21:11.359615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1233/2462] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:21:11.372543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4a5f3-1daf-4a9b-9614-8e9dce21f3c2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:21:11.384537 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4a5f3-1daf-4a9b-9614-8e9dce21f3c2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:21:11.388313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b963149-1775-4756-8186-905c1fa56cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:21:11.388956 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b963149-1775-4756-8186-905c1fa56cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:21:11.389239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b963149-1775-4756-8186-905c1fa56cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:21:11.389517 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b963149-1775-4756-8186-905c1fa56cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:21:11.398881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b963149-1775-4756-8186-905c1fa56cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:21:11.400443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b963149-1775-4756-8186-905c1fa56cdf service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:21:11.408906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1230/2463] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:21:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:21:11.493482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770c90-816d-4f3a-a6b1-2601cfdc1150 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:21:11.493769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770c90-816d-4f3a-a6b1-2601cfdc1150 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:21:11.494050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770c90-816d-4f3a-a6b1-2601cfdc1150 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:21:11.495459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1234/2464] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:21:11.500809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568df56-adb3-42e9-8d3a-b2bb42fe2126 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:21:11.501267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568df56-adb3-42e9-8d3a-b2bb42fe2126 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:21:11.501481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568df56-adb3-42e9-8d3a-b2bb42fe2126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:21:11.537968 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b568df56-adb3-42e9-8d3a-b2bb42fe2126 None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:21:11.539154 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b568df56-adb3-42e9-8d3a-b2bb42fe2126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:21:11.548944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1231/2465] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:21:11.560096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5770c90-816d-4f3a-a6b1-2601cfdc1150 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:21:11.570841 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5770c90-816d-4f3a-a6b1-2601cfdc1150 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:21:11.574386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ae80-9718-4216-aebe-c8a9d4d7cf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:21:11.575008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ae80-9718-4216-aebe-c8a9d4d7cf9f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:21:11.575290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ae80-9718-4216-aebe-c8a9d4d7cf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:21:11.575569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ae80-9718-4216-aebe-c8a9d4d7cf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:21:11.585414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ae80-9718-4216-aebe-c8a9d4d7cf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:21:11.586827 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ae80-9718-4216-aebe-c8a9d4d7cf9f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:21:11.598315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1235/2466] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:21:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:21:21.535601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=15 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:21:21.593288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=9 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:21:44.006600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe9745-f9d0-4d31-b966-0e3d2cc3d7dc None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:21:44.007081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe9745-f9d0-4d31-b966-0e3d2cc3d7dc None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:21:44.007188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe9745-f9d0-4d31-b966-0e3d2cc3d7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:21:44.024821 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2bfe9745-f9d0-4d31-b966-0e3d2cc3d7dc None None] MFA Rules not processed for user `4174d5226c454de9bd67dbce1aade939`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:21:44.025945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2bfe9745-f9d0-4d31-b966-0e3d2cc3d7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:21:44.079652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1232/2467] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:21:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:21:54.073057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=25 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:22:50.240936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ae80-9718-4216-aebe-c8a9d4d7cf9f service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:22:50.242387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7674ae80-9718-4216-aebe-c8a9d4d7cf9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:22:50.316279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ae80-9718-4216-aebe-c8a9d4d7cf9f service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:22:50.321518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6228f11-a7a8-41ed-9443-45200c7918b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:22:50.322213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228f11-a7a8-41ed-9443-45200c7918b7 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:22:50.322495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228f11-a7a8-41ed-9443-45200c7918b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:22:50.322770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6228f11-a7a8-41ed-9443-45200c7918b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:22:50.324630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f6228f11-a7a8-41ed-9443-45200c7918b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:22:50.337555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6228f11-a7a8-41ed-9443-45200c7918b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:22:50.339158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6228f11-a7a8-41ed-9443-45200c7918b7 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:22:50.351159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1236/2468] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:22:57.073834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe9745-f9d0-4d31-b966-0e3d2cc3d7dc None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:22:57.084105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe9745-f9d0-4d31-b966-0e3d2cc3d7dc None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:22:57.087561 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:22:57.088227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:22:57.088509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:22:57.088783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:22:57.090538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:22:57.103272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:22:57.104746 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:22:57.114484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1233/2469] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:22:58.490749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e807-7942-4f91-900f-0fe8eca53462 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:22:58.497730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e807-7942-4f91-900f-0fe8eca53462 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:22:58.497730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e807-7942-4f91-900f-0fe8eca53462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:22:58.565173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1605e807-7942-4f91-900f-0fe8eca53462 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:22:58.567736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1605e807-7942-4f91-900f-0fe8eca53462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:22:58.650474 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1237/2470] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:22:58.835716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:22:58.837218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:22:58.942748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9d7f3-8a88-4020-9a91-35dc401c7bb1 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:22:58.948167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9c750-a59e-4871-8e12-7a93fddbd870 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:22:58.948816 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9c750-a59e-4871-8e12-7a93fddbd870 service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:22:58.949102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9c750-a59e-4871-8e12-7a93fddbd870 service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:22:58.949394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9c750-a59e-4871-8e12-7a93fddbd870 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:22:58.958991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9c750-a59e-4871-8e12-7a93fddbd870 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:22:58.960630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9c750-a59e-4871-8e12-7a93fddbd870 service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:22:58.970529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1234/2471] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:22:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:23:01.622269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e807-7942-4f91-900f-0fe8eca53462 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:01.637911 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e807-7942-4f91-900f-0fe8eca53462 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:01.645778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd83159-0649-47d7-9ad4-eb98af6664c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:01.646732 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd83159-0649-47d7-9ad4-eb98af6664c7 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:01.647186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd83159-0649-47d7-9ad4-eb98af6664c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:01.647572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd83159-0649-47d7-9ad4-eb98af6664c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:01.649873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-efd83159-0649-47d7-9ad4-eb98af6664c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:01.664376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd83159-0649-47d7-9ad4-eb98af6664c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:01.667297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd83159-0649-47d7-9ad4-eb98af6664c7 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:01.689446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1238/2472] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:01.786653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9c750-a59e-4871-8e12-7a93fddbd870 service swift] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:01.788165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a7c9c750-a59e-4871-8e12-7a93fddbd870 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:01.803972 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9c750-a59e-4871-8e12-7a93fddbd870 service swift] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:01.808623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:01.809503 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:01.809785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:01.810065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] PATH_INFO: `/v3/users/41b13986fd754f0283047ddf865a19de` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:01.811299 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b13986fd754f0283047ddf865a19de)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:01.813869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:02.002490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b13986fd754f0283047ddf865a19de'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:02.015072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b13986fd754f0283047ddf865a19de'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:02.092613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b13986fd754f0283047ddf865a19de'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:02.099768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b13986fd754f0283047ddf865a19de'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:02.116175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-909d1630-8345-4c9e-97fb-c978a7012134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b13986fd754f0283047ddf865a19de'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:02.123850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1235/2473] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:01 2022] DELETE /identity/v3/users/41b13986fd754f0283047ddf865a19de => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:02.401209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd83159-0649-47d7-9ad4-eb98af6664c7 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:02.422831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd83159-0649-47d7-9ad4-eb98af6664c7 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:02.483314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:02.502038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:02.502932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:02.503214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:02.503543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] PATH_INFO: `/v3/projects/822f7e11da824c2e99d16797e987fa09` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:02.510281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822f7e11da824c2e99d16797e987fa09)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:02.512376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:02.668189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822f7e11da824c2e99d16797e987fa09', 'request_id': 'req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:03.086190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822f7e11da824c2e99d16797e987fa09', 'request_id': 'req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:03.093028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822f7e11da824c2e99d16797e987fa09', 'request_id': 'req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:03.103896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] The token cache is being invalidate because project 822f7e11da824c2e99d16797e987fa09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:03.104190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:03.104828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e6d4196-9b3f-4560-96a2-d3448dfb56f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:03.106351 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1239/2474] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:02 2022] DELETE /identity/v3/projects/822f7e11da824c2e99d16797e987fa09 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:03.112003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05685-ce36-4ef1-bfbf-89f3ec372585 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:03.112516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05685-ce36-4ef1-bfbf-89f3ec372585 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:03.112516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd05685-ce36-4ef1-bfbf-89f3ec372585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:03.131503 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3cd05685-ce36-4ef1-bfbf-89f3ec372585 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:03.138450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3cd05685-ce36-4ef1-bfbf-89f3ec372585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:03.164940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:03.207394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1236/2475] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:03.215345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93858793-a71b-41d7-967d-c6c23300b0d1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:03.215661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93858793-a71b-41d7-967d-c6c23300b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:03.215980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93858793-a71b-41d7-967d-c6c23300b0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:03.242575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-93858793-a71b-41d7-967d-c6c23300b0d1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:03.243850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-93858793-a71b-41d7-967d-c6c23300b0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:03.258241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1240/2476] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:03.262623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd05685-ce36-4ef1-bfbf-89f3ec372585 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:03.278506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd05685-ce36-4ef1-bfbf-89f3ec372585 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:03.284944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c894e-3aaf-4719-be9e-1775f7760531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:03.285624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c894e-3aaf-4719-be9e-1775f7760531 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:03.285910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c894e-3aaf-4719-be9e-1775f7760531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:03.286328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c894e-3aaf-4719-be9e-1775f7760531 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:03.287079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c894e-3aaf-4719-be9e-1775f7760531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:23:03.287388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c894e-3aaf-4719-be9e-1775f7760531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:03.289261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c894e-3aaf-4719-be9e-1775f7760531 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:03.308282 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1237/2477] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:23:03.310418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93858793-a71b-41d7-967d-c6c23300b0d1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:03.320697 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93858793-a71b-41d7-967d-c6c23300b0d1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:03.325754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ec3e3-f4e9-4514-8e8c-70016214fa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:03.326487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ec3e3-f4e9-4514-8e8c-70016214fa16 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:03.326775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ec3e3-f4e9-4514-8e8c-70016214fa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:03.327053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ec3e3-f4e9-4514-8e8c-70016214fa16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:03.328509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ec3e3-f4e9-4514-8e8c-70016214fa16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:03.332716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ec3e3-f4e9-4514-8e8c-70016214fa16 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:03.417636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1241/2478] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:03 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:03.425473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c894e-3aaf-4719-be9e-1775f7760531 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:03.437261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c894e-3aaf-4719-be9e-1775f7760531 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:03.512894 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2091b9-9b62-465b-ad26-ac9c2fd0b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:03.513719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2091b9-9b62-465b-ad26-ac9c2fd0b634 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:03.514080 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2091b9-9b62-465b-ad26-ac9c2fd0b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:03.514376 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2091b9-9b62-465b-ad26-ac9c2fd0b634 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:03.515198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2091b9-9b62-465b-ad26-ac9c2fd0b634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:03.517845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2091b9-9b62-465b-ad26-ac9c2fd0b634 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:03.627660 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1238/2479] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:03 2022] POST /identity/v3/users => generated 303 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:03.628573 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ec3e3-f4e9-4514-8e8c-70016214fa16 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:03.640138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ec3e3-f4e9-4514-8e8c-70016214fa16 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:03.648593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01c9f0-cdc0-40bd-bc2d-4efd36fc6a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:03.649267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01c9f0-cdc0-40bd-bc2d-4efd36fc6a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:03.649545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01c9f0-cdc0-40bd-bc2d-4efd36fc6a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:03.650040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01c9f0-cdc0-40bd-bc2d-4efd36fc6a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:03.651761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01c9f0-cdc0-40bd-bc2d-4efd36fc6a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:03.653753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01c9f0-cdc0-40bd-bc2d-4efd36fc6a94 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:03.668993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1242/2480] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:03.673148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2091b9-9b62-465b-ad26-ac9c2fd0b634 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:03.684819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2091b9-9b62-465b-ad26-ac9c2fd0b634 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:03.689938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99a65a-50a2-49be-8bb0-f0c473db864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:03.690727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99a65a-50a2-49be-8bb0-f0c473db864a admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:03.691092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99a65a-50a2-49be-8bb0-f0c473db864a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:03.691534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99a65a-50a2-49be-8bb0-f0c473db864a admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:03.692485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99a65a-50a2-49be-8bb0-f0c473db864a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:03.694414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99a65a-50a2-49be-8bb0-f0c473db864a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:03.706793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1239/2481] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:23:03.710731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01c9f0-cdc0-40bd-bc2d-4efd36fc6a94 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:03.722393 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01c9f0-cdc0-40bd-bc2d-4efd36fc6a94 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:03.727645 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6f986-cfd8-45bb-a398-4e8736cff0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:03.728569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6f986-cfd8-45bb-a398-4e8736cff0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:03.728856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6f986-cfd8-45bb-a398-4e8736cff0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:03.729128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6f986-cfd8-45bb-a398-4e8736cff0bf admin admin] PATH_INFO: `/v3/projects/28920ff653a54aa98cf08690cab9bdd9/users/f7fadfaef623486da7097937707f2ad6/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:03.744552 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6f986-cfd8-45bb-a398-4e8736cff0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=28920ff653a54aa98cf08690cab9bdd9, user_id=f7fadfaef623486da7097937707f2ad6, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:03.747188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6f986-cfd8-45bb-a398-4e8736cff0bf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:03.850106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1243/2482] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:03 2022] PUT /identity/v3/projects/28920ff653a54aa98cf08690cab9bdd9/users/f7fadfaef623486da7097937707f2ad6/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:03.855120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8e1b4-abf6-4ab6-ba81-296a367cac63 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:03.862058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8e1b4-abf6-4ab6-ba81-296a367cac63 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:03.862058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8e1b4-abf6-4ab6-ba81-296a367cac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:03.886889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-83f8e1b4-abf6-4ab6-ba81-296a367cac63 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:03.888898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-83f8e1b4-abf6-4ab6-ba81-296a367cac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:03.959233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1240/2483] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:03.970567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6f986-cfd8-45bb-a398-4e8736cff0bf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:03.975720 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e3f6f986-cfd8-45bb-a398-4e8736cff0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:04.038062 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6f986-cfd8-45bb-a398-4e8736cff0bf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:04.042014 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265986e-0e5d-429d-8180-5579ab556b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:04.042658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265986e-0e5d-429d-8180-5579ab556b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:04.042940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265986e-0e5d-429d-8180-5579ab556b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:04.043212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265986e-0e5d-429d-8180-5579ab556b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:04.052567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265986e-0e5d-429d-8180-5579ab556b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:04.053988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265986e-0e5d-429d-8180-5579ab556b78 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:04.066156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1244/2484] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:05.362398 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9acc9-0ef7-4693-98a4-dc4052973129 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:05.369251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9acc9-0ef7-4693-98a4-dc4052973129 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:05.369251 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9acc9-0ef7-4693-98a4-dc4052973129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:05.399848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-aae9acc9-0ef7-4693-98a4-dc4052973129 None None] MFA Rules not processed for user `f7fadfaef623486da7097937707f2ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:05.401531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aae9acc9-0ef7-4693-98a4-dc4052973129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:05.430101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:05.498691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1241/2485] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:05.499586 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265986e-0e5d-429d-8180-5579ab556b78 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:05.515939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265986e-0e5d-429d-8180-5579ab556b78 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:05.525777 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bd6f4-82e6-49d7-b1eb-893fc570d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:05.526574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bd6f4-82e6-49d7-b1eb-893fc570d14f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:05.526859 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bd6f4-82e6-49d7-b1eb-893fc570d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:05.527139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bd6f4-82e6-49d7-b1eb-893fc570d14f admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:05.527858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bd6f4-82e6-49d7-b1eb-893fc570d14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:05.529915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bd6f4-82e6-49d7-b1eb-893fc570d14f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:05.548446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:05.644492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1245/2486] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:05 2022] POST /identity/v3/projects => generated 403 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:23:05.648580 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9acc9-0ef7-4693-98a4-dc4052973129 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:05.660685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9acc9-0ef7-4693-98a4-dc4052973129 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:05.732230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf4e31-3c7f-4cab-9b46-5466a1fa91c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:05.733029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf4e31-3c7f-4cab-9b46-5466a1fa91c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:05.733387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf4e31-3c7f-4cab-9b46-5466a1fa91c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:05.733759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf4e31-3c7f-4cab-9b46-5466a1fa91c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:05.734582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf4e31-3c7f-4cab-9b46-5466a1fa91c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:05.737644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf4e31-3c7f-4cab-9b46-5466a1fa91c3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:05.879078 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1242/2487] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:05 2022] POST /identity/v3/users => generated 308 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:05.883376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bd6f4-82e6-49d7-b1eb-893fc570d14f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:05.896552 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bd6f4-82e6-49d7-b1eb-893fc570d14f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:05.902813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05eaea-f5ae-4fdf-b7d4-7934845e8954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:05.903649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05eaea-f5ae-4fdf-b7d4-7934845e8954 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:05.903978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05eaea-f5ae-4fdf-b7d4-7934845e8954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:05.904261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05eaea-f5ae-4fdf-b7d4-7934845e8954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:05.905045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05eaea-f5ae-4fdf-b7d4-7934845e8954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:05.906732 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05eaea-f5ae-4fdf-b7d4-7934845e8954 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:05.926210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1246/2488] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:05.930878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf4e31-3c7f-4cab-9b46-5466a1fa91c3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:05.947823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf4e31-3c7f-4cab-9b46-5466a1fa91c3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:05.955836 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ef90-300c-432e-9678-131831b5340f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:05.956796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ef90-300c-432e-9678-131831b5340f admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:05.957138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ef90-300c-432e-9678-131831b5340f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:05.957412 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ef90-300c-432e-9678-131831b5340f admin admin] PATH_INFO: `/v3/projects/68a80c13aeca4bdd841c7797896ea3eb/users/9711c13369f541718efad679311a2dfe/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:05.979696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ef90-300c-432e-9678-131831b5340f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a80c13aeca4bdd841c7797896ea3eb, user_id=9711c13369f541718efad679311a2dfe, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:05.983739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ef90-300c-432e-9678-131831b5340f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:06.118465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1243/2489] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:05 2022] PUT /identity/v3/projects/68a80c13aeca4bdd841c7797896ea3eb/users/9711c13369f541718efad679311a2dfe/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:06.123145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05eaea-f5ae-4fdf-b7d4-7934845e8954 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:06.136611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05eaea-f5ae-4fdf-b7d4-7934845e8954 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:06.212455 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97a7a6-dafc-4dc1-adf9-36b2b059b61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:06.215493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97a7a6-dafc-4dc1-adf9-36b2b059b61f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:06.215493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97a7a6-dafc-4dc1-adf9-36b2b059b61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:06.215493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97a7a6-dafc-4dc1-adf9-36b2b059b61f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:06.215493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97a7a6-dafc-4dc1-adf9-36b2b059b61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:06.217007 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97a7a6-dafc-4dc1-adf9-36b2b059b61f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:06.230917 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1247/2490] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:06.234249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ef90-300c-432e-9678-131831b5340f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:06.246289 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ef90-300c-432e-9678-131831b5340f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:06.252468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d106c-e760-4fc8-b457-6d608ae82304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:06.253710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d106c-e760-4fc8-b457-6d608ae82304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:06.253710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d106c-e760-4fc8-b457-6d608ae82304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:06.254193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d106c-e760-4fc8-b457-6d608ae82304 admin admin] PATH_INFO: `/v3/projects/68a80c13aeca4bdd841c7797896ea3eb/users/9711c13369f541718efad679311a2dfe/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:06.256301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d106c-e760-4fc8-b457-6d608ae82304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a80c13aeca4bdd841c7797896ea3eb, user_id=9711c13369f541718efad679311a2dfe, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:06.259108 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d106c-e760-4fc8-b457-6d608ae82304 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:06.275119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1244/2491] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:06 2022] PUT /identity/v3/projects/68a80c13aeca4bdd841c7797896ea3eb/users/9711c13369f541718efad679311a2dfe/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:08.146158 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec1118-61e4-4334-8757-6740d8262321 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:08.146687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec1118-61e4-4334-8757-6740d8262321 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:08.146874 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec1118-61e4-4334-8757-6740d8262321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:08.185192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d7ec1118-61e4-4334-8757-6740d8262321 None None] MFA Rules not processed for user `9711c13369f541718efad679311a2dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:08.188559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d7ec1118-61e4-4334-8757-6740d8262321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:08.272547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1248/2492] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:09.848029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d106c-e760-4fc8-b457-6d608ae82304 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:09.939824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d106c-e760-4fc8-b457-6d608ae82304 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:09.946504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:09.948072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:09.948209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:09.948445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] PATH_INFO: `/v3/users/f7fadfaef623486da7097937707f2ad6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:09.949659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fadfaef623486da7097937707f2ad6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:09.951758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:09.984743 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:10.304590 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec1118-61e4-4334-8757-6740d8262321 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:10.307338 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d7ec1118-61e4-4334-8757-6740d8262321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:10.378494 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec1118-61e4-4334-8757-6740d8262321 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:10.382334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b02f0-a523-4daa-adc3-fa12e3c1ef89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:10.383202 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b02f0-a523-4daa-adc3-fa12e3c1ef89 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:10.383482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b02f0-a523-4daa-adc3-fa12e3c1ef89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:10.383756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b02f0-a523-4daa-adc3-fa12e3c1ef89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:10.385795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9c1b02f0-a523-4daa-adc3-fa12e3c1ef89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:10.413935 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:10.462004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b02f0-a523-4daa-adc3-fa12e3c1ef89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:10.463385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b02f0-a523-4daa-adc3-fa12e3c1ef89 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:10.473597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1249/2493] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:23:10.967345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fadfaef623486da7097937707f2ad6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:10.974993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fadfaef623486da7097937707f2ad6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:11.051888 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fadfaef623486da7097937707f2ad6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:11.052862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fadfaef623486da7097937707f2ad6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:11.067563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fadfaef623486da7097937707f2ad6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:11.073913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1245/2494] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:09 2022] DELETE /identity/v3/users/f7fadfaef623486da7097937707f2ad6 => generated 0 bytes in 1226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:11.399670 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b02f0-a523-4daa-adc3-fa12e3c1ef89 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:11.412309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b02f0-a523-4daa-adc3-fa12e3c1ef89 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:11.542995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:11.544636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:11.554371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:11.554371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] PATH_INFO: `/v3/projects/28920ff653a54aa98cf08690cab9bdd9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:11.554371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28920ff653a54aa98cf08690cab9bdd9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:11.554371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:11.704472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28920ff653a54aa98cf08690cab9bdd9', 'request_id': 'req-139856f6-b2b1-480b-9261-eab556235829'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:11.928061 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28920ff653a54aa98cf08690cab9bdd9', 'request_id': 'req-139856f6-b2b1-480b-9261-eab556235829'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:11.937181 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28920ff653a54aa98cf08690cab9bdd9', 'request_id': 'req-139856f6-b2b1-480b-9261-eab556235829'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:11.968559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] The token cache is being invalidate because project 28920ff653a54aa98cf08690cab9bdd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:11.969025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:11.969766 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:11.971764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1250/2495] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:11 2022] DELETE /identity/v3/projects/28920ff653a54aa98cf08690cab9bdd9 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:11.975480 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:11.977018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:11.991955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f69a0-4d68-4ad1-8d5c-c37c6c4f40eb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:12.078636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:12.080932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:12.081218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:12.081494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] PATH_INFO: `/v3/users/9711c13369f541718efad679311a2dfe` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:12.086397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9711c13369f541718efad679311a2dfe)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:12.088404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:12.302350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9711c13369f541718efad679311a2dfe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:12.310929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9711c13369f541718efad679311a2dfe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:12.382725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9711c13369f541718efad679311a2dfe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:12.383359 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9711c13369f541718efad679311a2dfe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:12.398583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2cfa7236-5949-4e6d-9990-6641fa5c812a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9711c13369f541718efad679311a2dfe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:12.404789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1246/2496] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:11 2022] DELETE /identity/v3/users/9711c13369f541718efad679311a2dfe => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:12.672812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:12.674359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:12.691196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139856f6-b2b1-480b-9261-eab556235829 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:12.740150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:12.751023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:12.752068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:12.752360 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:12.752646 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] PATH_INFO: `/v3/projects/68a80c13aeca4bdd841c7797896ea3eb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:12.753869 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a80c13aeca4bdd841c7797896ea3eb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:12.755916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:12.875660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a80c13aeca4bdd841c7797896ea3eb', 'request_id': 'req-4ad37bf7-8a61-4291-91c2-42783c8e7a50'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:12.977220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a80c13aeca4bdd841c7797896ea3eb', 'request_id': 'req-4ad37bf7-8a61-4291-91c2-42783c8e7a50'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:12.984020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a80c13aeca4bdd841c7797896ea3eb', 'request_id': 'req-4ad37bf7-8a61-4291-91c2-42783c8e7a50'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:12.994443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] The token cache is being invalidate because project 68a80c13aeca4bdd841c7797896ea3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:13.003223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:13.003223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4ad37bf7-8a61-4291-91c2-42783c8e7a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:13.003223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1251/2497] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:12 2022] DELETE /identity/v3/projects/68a80c13aeca4bdd841c7797896ea3eb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:13.003505 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff6687-250b-4475-b2cb-a0fea8e6fc50 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.003505 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff6687-250b-4475-b2cb-a0fea8e6fc50 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.003505 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff6687-250b-4475-b2cb-a0fea8e6fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.021720 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-adff6687-250b-4475-b2cb-a0fea8e6fc50 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:13.022935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-adff6687-250b-4475-b2cb-a0fea8e6fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:13.033058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:13.083259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1247/2498] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:23:13.091083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5541-203e-4a55-ae17-138542048758 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.091374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5541-203e-4a55-ae17-138542048758 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.091651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5541-203e-4a55-ae17-138542048758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.110044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c73c5541-203e-4a55-ae17-138542048758 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:13.111252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c73c5541-203e-4a55-ae17-138542048758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:13.119233 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1252/2499] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:13.123449 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff6687-250b-4475-b2cb-a0fea8e6fc50 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:13.133918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff6687-250b-4475-b2cb-a0fea8e6fc50 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:13.138647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ae050-2d4f-49a9-a4ed-99a96df96965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:13.139296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ae050-2d4f-49a9-a4ed-99a96df96965 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.139576 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ae050-2d4f-49a9-a4ed-99a96df96965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.139847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ae050-2d4f-49a9-a4ed-99a96df96965 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.141207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ae050-2d4f-49a9-a4ed-99a96df96965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:23:13.141509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ae050-2d4f-49a9-a4ed-99a96df96965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:13.143231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ae050-2d4f-49a9-a4ed-99a96df96965 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:13.154332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1248/2500] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:23:13.159073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5541-203e-4a55-ae17-138542048758 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:13.168238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5541-203e-4a55-ae17-138542048758 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:13.173514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b5df-90e2-4121-ad20-b9ac9785b872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:13.174156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b5df-90e2-4121-ad20-b9ac9785b872 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.174686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b5df-90e2-4121-ad20-b9ac9785b872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.174960 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686b5df-90e2-4121-ad20-b9ac9785b872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.175655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686b5df-90e2-4121-ad20-b9ac9785b872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:13.177594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686b5df-90e2-4121-ad20-b9ac9785b872 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:13.263213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1253/2501] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:13 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:13.264288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ae050-2d4f-49a9-a4ed-99a96df96965 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:13.274792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ae050-2d4f-49a9-a4ed-99a96df96965 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:13.335729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae4b2a-22a2-4d8b-aaf2-dacc3390f40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:13.336020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae4b2a-22a2-4d8b-aaf2-dacc3390f40b admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.336350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae4b2a-22a2-4d8b-aaf2-dacc3390f40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.336573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae4b2a-22a2-4d8b-aaf2-dacc3390f40b admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.337267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae4b2a-22a2-4d8b-aaf2-dacc3390f40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:13.339231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae4b2a-22a2-4d8b-aaf2-dacc3390f40b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:13.419566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1249/2502] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:13 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:13.425805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b5df-90e2-4121-ad20-b9ac9785b872 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:13.435865 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686b5df-90e2-4121-ad20-b9ac9785b872 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:13.442424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe8fd-eafd-438d-832a-314d9772e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:13.443262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe8fd-eafd-438d-832a-314d9772e669 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.443579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe8fd-eafd-438d-832a-314d9772e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.443980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe8fd-eafd-438d-832a-314d9772e669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.444719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe8fd-eafd-438d-832a-314d9772e669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:13.446326 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe8fd-eafd-438d-832a-314d9772e669 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:13.460958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1254/2503] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:13.462672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae4b2a-22a2-4d8b-aaf2-dacc3390f40b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:13.473374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae4b2a-22a2-4d8b-aaf2-dacc3390f40b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:13.478173 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d18e50-eed5-4daa-b430-d7938abfeb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:13.478843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d18e50-eed5-4daa-b430-d7938abfeb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.479127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d18e50-eed5-4daa-b430-d7938abfeb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.479404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d18e50-eed5-4daa-b430-d7938abfeb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.480163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d18e50-eed5-4daa-b430-d7938abfeb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:13.482775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d18e50-eed5-4daa-b430-d7938abfeb9c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:13.493045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1250/2504] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:13.497242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe8fd-eafd-438d-832a-314d9772e669 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:13.509708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe8fd-eafd-438d-832a-314d9772e669 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:13.514427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2bafe-3d55-4d58-b6a1-fb3770645a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:13.515978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2bafe-3d55-4d58-b6a1-fb3770645a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.516266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2bafe-3d55-4d58-b6a1-fb3770645a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.516542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2bafe-3d55-4d58-b6a1-fb3770645a10 admin admin] PATH_INFO: `/v3/projects/67f843aa54b74d269709888c8e6d19f1/users/c66c4cb3fe5049d0a476283eb261a885/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.532800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2bafe-3d55-4d58-b6a1-fb3770645a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f843aa54b74d269709888c8e6d19f1, user_id=c66c4cb3fe5049d0a476283eb261a885, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:13.535743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2bafe-3d55-4d58-b6a1-fb3770645a10 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:13.610052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1255/2505] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:13 2022] PUT /identity/v3/projects/67f843aa54b74d269709888c8e6d19f1/users/c66c4cb3fe5049d0a476283eb261a885/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:13.622020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe00b2-7926-43fc-8f4a-736e2b93c23c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.622371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe00b2-7926-43fc-8f4a-736e2b93c23c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.622744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe00b2-7926-43fc-8f4a-736e2b93c23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.666622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-01fe00b2-7926-43fc-8f4a-736e2b93c23c None None] MFA Rules not processed for user `c66c4cb3fe5049d0a476283eb261a885`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:13.667896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-01fe00b2-7926-43fc-8f4a-736e2b93c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:13.756712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1251/2506] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:13.761334 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2bafe-3d55-4d58-b6a1-fb3770645a10 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:13.826853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2bafe-3d55-4d58-b6a1-fb3770645a10 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:13.832147 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fba0d2-d666-45c0-bf7e-0ef7f924078e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:13.832829 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fba0d2-d666-45c0-bf7e-0ef7f924078e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:13.833116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fba0d2-d666-45c0-bf7e-0ef7f924078e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:13.833413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fba0d2-d666-45c0-bf7e-0ef7f924078e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:13.834113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fba0d2-d666-45c0-bf7e-0ef7f924078e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:13.836053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fba0d2-d666-45c0-bf7e-0ef7f924078e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:13.944375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1256/2507] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:13 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:23:13.945515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe00b2-7926-43fc-8f4a-736e2b93c23c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:13.956984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe00b2-7926-43fc-8f4a-736e2b93c23c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:13.965027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:14.014122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c926a-85c9-4528-a93d-b359737f56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:14.014785 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c926a-85c9-4528-a93d-b359737f56a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:14.015064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c926a-85c9-4528-a93d-b359737f56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:14.015914 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c926a-85c9-4528-a93d-b359737f56a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:14.016884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c926a-85c9-4528-a93d-b359737f56a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:14.018852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c926a-85c9-4528-a93d-b359737f56a1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:14.116012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1252/2508] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:13 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:14.120793 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fba0d2-d666-45c0-bf7e-0ef7f924078e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:14.128311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:14.139900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fba0d2-d666-45c0-bf7e-0ef7f924078e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:14.146940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f3e21-5cea-436f-a4e7-e87d69dc5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:14.147780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f3e21-5cea-436f-a4e7-e87d69dc5a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:14.148191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f3e21-5cea-436f-a4e7-e87d69dc5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:14.150629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f3e21-5cea-436f-a4e7-e87d69dc5a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:14.151420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f3e21-5cea-436f-a4e7-e87d69dc5a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:14.153616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f3e21-5cea-436f-a4e7-e87d69dc5a00 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:14.166820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1257/2509] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:14.171139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c926a-85c9-4528-a93d-b359737f56a1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:14.181835 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c926a-85c9-4528-a93d-b359737f56a1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:14.186557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d2f8a-2623-43e4-8201-35cf66e054c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:14.187644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d2f8a-2623-43e4-8201-35cf66e054c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:14.187957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d2f8a-2623-43e4-8201-35cf66e054c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:14.188236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d2f8a-2623-43e4-8201-35cf66e054c0 admin admin] PATH_INFO: `/v3/projects/43de12d59af743199761e9806506431c/users/12f340babdc64220bc5ecff1bab46073/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:14.205030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d2f8a-2623-43e4-8201-35cf66e054c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43de12d59af743199761e9806506431c, user_id=12f340babdc64220bc5ecff1bab46073, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:14.207691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d2f8a-2623-43e4-8201-35cf66e054c0 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:14.286338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1253/2510] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:14 2022] PUT /identity/v3/projects/43de12d59af743199761e9806506431c/users/12f340babdc64220bc5ecff1bab46073/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:14.290322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f3e21-5cea-436f-a4e7-e87d69dc5a00 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:14.300484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f3e21-5cea-436f-a4e7-e87d69dc5a00 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:14.356291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2bc6d-b445-4043-9ac0-f74d24680e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:14.364261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2bc6d-b445-4043-9ac0-f74d24680e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:14.364261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2bc6d-b445-4043-9ac0-f74d24680e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:14.364261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2bc6d-b445-4043-9ac0-f74d24680e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:14.364261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2bc6d-b445-4043-9ac0-f74d24680e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:14.364261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2bc6d-b445-4043-9ac0-f74d24680e40 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:14.369965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1258/2511] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:14.374256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d2f8a-2623-43e4-8201-35cf66e054c0 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:14.388207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d2f8a-2623-43e4-8201-35cf66e054c0 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:14.394172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd804fb-26be-4e82-9507-1ee87b90a5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:14.395114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd804fb-26be-4e82-9507-1ee87b90a5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:14.395403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd804fb-26be-4e82-9507-1ee87b90a5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:14.395676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd804fb-26be-4e82-9507-1ee87b90a5f7 admin admin] PATH_INFO: `/v3/projects/43de12d59af743199761e9806506431c/users/12f340babdc64220bc5ecff1bab46073/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:14.397700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd804fb-26be-4e82-9507-1ee87b90a5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43de12d59af743199761e9806506431c, user_id=12f340babdc64220bc5ecff1bab46073, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:14.400404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd804fb-26be-4e82-9507-1ee87b90a5f7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:14.411166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1254/2512] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:14 2022] PUT /identity/v3/projects/43de12d59af743199761e9806506431c/users/12f340babdc64220bc5ecff1bab46073/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:14.421420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686b6c-202f-4ef5-995b-ab6a84905a3f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:14.421776 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686b6c-202f-4ef5-995b-ab6a84905a3f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:14.422526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686b6c-202f-4ef5-995b-ab6a84905a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:14.450972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9b686b6c-202f-4ef5-995b-ab6a84905a3f None None] MFA Rules not processed for user `12f340babdc64220bc5ecff1bab46073`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:14.452348 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b686b6c-202f-4ef5-995b-ab6a84905a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:14.529210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1259/2513] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:14.542160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd804fb-26be-4e82-9507-1ee87b90a5f7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:14.543978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-6fd804fb-26be-4e82-9507-1ee87b90a5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:14.602543 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd804fb-26be-4e82-9507-1ee87b90a5f7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:14.606186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c7aee-11fc-4c42-a28e-a973060d0894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:14.606830 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c7aee-11fc-4c42-a28e-a973060d0894 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:14.607116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c7aee-11fc-4c42-a28e-a973060d0894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:14.607386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c7aee-11fc-4c42-a28e-a973060d0894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:14.616834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c7aee-11fc-4c42-a28e-a973060d0894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:14.618267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c7aee-11fc-4c42-a28e-a973060d0894 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:14.628294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1255/2514] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:15.661635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686b6c-202f-4ef5-995b-ab6a84905a3f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:15.670896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686b6c-202f-4ef5-995b-ab6a84905a3f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:15.676001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7bea8-829d-44ff-b0a4-4a9dc4ee753c tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f340babdc64220bc5ecff1bab46073', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43de12d59af743199761e9806506431c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:15.676826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7bea8-829d-44ff-b0a4-4a9dc4ee753c tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:15.677029 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7bea8-829d-44ff-b0a4-4a9dc4ee753c tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:15.677217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7bea8-829d-44ff-b0a4-4a9dc4ee753c tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:15.678011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7bea8-829d-44ff-b0a4-4a9dc4ee753c tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:23:15.678321 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7bea8-829d-44ff-b0a4-4a9dc4ee753c tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:15.679953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7bea8-829d-44ff-b0a4-4a9dc4ee753c tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:15.695833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1260/2515] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:23:15.697030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c7aee-11fc-4c42-a28e-a973060d0894 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:15.707244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c7aee-11fc-4c42-a28e-a973060d0894 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:15.712064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda173d1-ab9c-4912-8e88-afde784ea074 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f340babdc64220bc5ecff1bab46073', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43de12d59af743199761e9806506431c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:15.712663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda173d1-ab9c-4912-8e88-afde784ea074 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:15.712951 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda173d1-ab9c-4912-8e88-afde784ea074 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:15.713258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda173d1-ab9c-4912-8e88-afde784ea074 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:15.713965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda173d1-ab9c-4912-8e88-afde784ea074 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:15.715897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda173d1-ab9c-4912-8e88-afde784ea074 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:15.809540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1256/2516] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:15 2022] POST /identity/v3/projects => generated 354 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:15.813860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7bea8-829d-44ff-b0a4-4a9dc4ee753c tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:15.824483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7bea8-829d-44ff-b0a4-4a9dc4ee753c tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:15.882318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f340babdc64220bc5ecff1bab46073', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43de12d59af743199761e9806506431c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:15.883213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:15.883512 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:15.883802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:15.884583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:23:15.884902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:15.886509 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:15.888013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:15.900180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1261/2517] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:23:15.935981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda173d1-ab9c-4912-8e88-afde784ea074 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:15.947091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda173d1-ab9c-4912-8e88-afde784ea074 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:15.951825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f340babdc64220bc5ecff1bab46073', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43de12d59af743199761e9806506431c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:15.961803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:15.961803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:15.961803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] PATH_INFO: `/v3/projects/af2fc2547de94a9aa51d08859a67a50b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:15.961803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af2fc2547de94a9aa51d08859a67a50b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:15.962238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:16.077631 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:16.085465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2fc2547de94a9aa51d08859a67a50b', 'request_id': 'req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:16.091748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2fc2547de94a9aa51d08859a67a50b', 'request_id': 'req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:16.097510 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2fc2547de94a9aa51d08859a67a50b', 'request_id': 'req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:16.161857 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] The token cache is being invalidate because project af2fc2547de94a9aa51d08859a67a50b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:16.162141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:16.162790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e0ba0be3-f09b-45df-a136-e76d4b3be9e9 tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:16.164369 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1257/2518] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:15 2022] DELETE /identity/v3/projects/af2fc2547de94a9aa51d08859a67a50b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:16.737649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:16.739415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:16.804575 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5a18f-f99b-409c-aa6f-da61aacde0ba tempest-VolumeQuotaClassesTest-942713058 tempest-VolumeQuotaClassesTest-942713058-project-admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:16.871899 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:16.877828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:16.877828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:16.877828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] PATH_INFO: `/v3/users/c66c4cb3fe5049d0a476283eb261a885` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:16.877828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66c4cb3fe5049d0a476283eb261a885)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:16.877828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:17.089866 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66c4cb3fe5049d0a476283eb261a885'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:17.097174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66c4cb3fe5049d0a476283eb261a885'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:17.097845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66c4cb3fe5049d0a476283eb261a885'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:17.110550 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66c4cb3fe5049d0a476283eb261a885'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:17.202230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66c4cb3fe5049d0a476283eb261a885'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:17.209896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1262/2519] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:16 2022] DELETE /identity/v3/users/c66c4cb3fe5049d0a476283eb261a885 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:17.214478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e4607-748d-4bb3-b9ec-467642dc5f75 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:17.214967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e4607-748d-4bb3-b9ec-467642dc5f75 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:17.215135 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e4607-748d-4bb3-b9ec-467642dc5f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:17.240375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-960e4607-748d-4bb3-b9ec-467642dc5f75 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:17.241786 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-960e4607-748d-4bb3-b9ec-467642dc5f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:17.300320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1258/2520] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:17.310725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:17.313206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:17.335434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:17.371748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9f4a5-2790-48ff-9c20-ab9a267b305f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:17.377791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3a249-b3b6-41b7-ac69-e20be8547757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:17.378483 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a249-b3b6-41b7-ac69-e20be8547757 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:17.378768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a249-b3b6-41b7-ac69-e20be8547757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:17.379046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a249-b3b6-41b7-ac69-e20be8547757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:17.389929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3a249-b3b6-41b7-ac69-e20be8547757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:17.393147 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3a249-b3b6-41b7-ac69-e20be8547757 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:17.403142 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1263/2521] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:17.840394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e4607-748d-4bb3-b9ec-467642dc5f75 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:17.841407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-960e4607-748d-4bb3-b9ec-467642dc5f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:17.863124 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e4607-748d-4bb3-b9ec-467642dc5f75 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:17.870725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:17.871611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:17.872001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:17.872288 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] PATH_INFO: `/v3/projects/67f843aa54b74d269709888c8e6d19f1` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:17.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f843aa54b74d269709888c8e6d19f1)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:17.875935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:17.987884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f843aa54b74d269709888c8e6d19f1', 'request_id': 'req-5102d53e-cba6-4163-8403-bcabd7d9d1c7'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:17.994513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f843aa54b74d269709888c8e6d19f1', 'request_id': 'req-5102d53e-cba6-4163-8403-bcabd7d9d1c7'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:18.000355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f843aa54b74d269709888c8e6d19f1', 'request_id': 'req-5102d53e-cba6-4163-8403-bcabd7d9d1c7'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:18.073750 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] The token cache is being invalidate because project 67f843aa54b74d269709888c8e6d19f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:18.074061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:18.074765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:18.076391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1259/2522] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:17 2022] DELETE /identity/v3/projects/67f843aa54b74d269709888c8e6d19f1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:18.081222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3a249-b3b6-41b7-ac69-e20be8547757 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:18.090993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3a249-b3b6-41b7-ac69-e20be8547757 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:18.152436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:18.153344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:18.153629 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:18.153906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] PATH_INFO: `/v3/users/12f340babdc64220bc5ecff1bab46073` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:18.155134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f340babdc64220bc5ecff1bab46073)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:18.157517 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:18.389488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f340babdc64220bc5ecff1bab46073'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:18.397724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f340babdc64220bc5ecff1bab46073'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:18.398439 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f340babdc64220bc5ecff1bab46073'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:18.411485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f340babdc64220bc5ecff1bab46073'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:18.485544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-abbc0760-06fe-4aa9-9373-5ad136a1b442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f340babdc64220bc5ecff1bab46073'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:18.492099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1264/2523] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:18 2022] DELETE /identity/v3/users/12f340babdc64220bc5ecff1bab46073 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:18.923945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:18.925648 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:18.938975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102d53e-cba6-4163-8403-bcabd7d9d1c7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:18.986852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:18.996407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:18.997293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:18.997577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:18.997855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] PATH_INFO: `/v3/projects/43de12d59af743199761e9806506431c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:18.999055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43de12d59af743199761e9806506431c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:19.001014 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:19.100345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43de12d59af743199761e9806506431c', 'request_id': 'req-0825d484-565e-41a7-8375-861e8ca01b53'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:19.106483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43de12d59af743199761e9806506431c', 'request_id': 'req-0825d484-565e-41a7-8375-861e8ca01b53'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:19.112763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43de12d59af743199761e9806506431c', 'request_id': 'req-0825d484-565e-41a7-8375-861e8ca01b53'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:19.190154 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] The token cache is being invalidate because project 43de12d59af743199761e9806506431c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:19.190427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:19.191048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-0825d484-565e-41a7-8375-861e8ca01b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:19.192667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1260/2524] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:18 2022] DELETE /identity/v3/projects/43de12d59af743199761e9806506431c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:19.197639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de25489-7063-4f35-b551-11b082a9b95d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.198163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de25489-7063-4f35-b551-11b082a9b95d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.198278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de25489-7063-4f35-b551-11b082a9b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.216654 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2de25489-7063-4f35-b551-11b082a9b95d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:19.217891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2de25489-7063-4f35-b551-11b082a9b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:19.256785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:19.277757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1265/2525] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:23:19.286141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fb887-fb33-454b-b883-650f4abe30bd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.286431 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fb887-fb33-454b-b883-650f4abe30bd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.286714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fb887-fb33-454b-b883-650f4abe30bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.305338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0a7fb887-fb33-454b-b883-650f4abe30bd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:19.308115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0a7fb887-fb33-454b-b883-650f4abe30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:19.314620 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1261/2526] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:19.318867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de25489-7063-4f35-b551-11b082a9b95d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:19.330749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de25489-7063-4f35-b551-11b082a9b95d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:19.336246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bfc73-7cd2-4c36-bb98-d48746072ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:19.338912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bfc73-7cd2-4c36-bb98-d48746072ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.338912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bfc73-7cd2-4c36-bb98-d48746072ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.338912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bfc73-7cd2-4c36-bb98-d48746072ae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.338912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bfc73-7cd2-4c36-bb98-d48746072ae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:23:19.338912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bfc73-7cd2-4c36-bb98-d48746072ae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:19.340223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bfc73-7cd2-4c36-bb98-d48746072ae8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:19.363784 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1266/2527] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:23:19.369178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fb887-fb33-454b-b883-650f4abe30bd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:19.397442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fb887-fb33-454b-b883-650f4abe30bd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:19.397442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd06b5-70a2-4baf-83fe-1abf7b69f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:19.397442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd06b5-70a2-4baf-83fe-1abf7b69f848 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.397442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd06b5-70a2-4baf-83fe-1abf7b69f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.397822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd06b5-70a2-4baf-83fe-1abf7b69f848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.397822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd06b5-70a2-4baf-83fe-1abf7b69f848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:19.397822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd06b5-70a2-4baf-83fe-1abf7b69f848 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:19.502470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a1480-1db6-4b2f-bed9-4d8ca9ee3b84 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.502780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a1480-1db6-4b2f-bed9-4d8ca9ee3b84 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.503071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a1480-1db6-4b2f-bed9-4d8ca9ee3b84 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.505165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1267/2528] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:23:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 12:23:19.510684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b7f5-f2f9-4a1f-a32b-8fecbac0c996 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.510981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b7f5-f2f9-4a1f-a32b-8fecbac0c996 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.511266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b7f5-f2f9-4a1f-a32b-8fecbac0c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.533132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3fb8b7f5-f2f9-4a1f-a32b-8fecbac0c996 None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:19.535913 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3fb8b7f5-f2f9-4a1f-a32b-8fecbac0c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:19.536160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1262/2529] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:19 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:23:19.538527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd06b5-70a2-4baf-83fe-1abf7b69f848 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:19.619064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1268/2530] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:23:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:23:19.619460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd06b5-70a2-4baf-83fe-1abf7b69f848 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:19.624724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae83dba-8245-4f78-88a4-1c8c9e19dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:19.626519 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae83dba-8245-4f78-88a4-1c8c9e19dac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.626832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae83dba-8245-4f78-88a4-1c8c9e19dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.627128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae83dba-8245-4f78-88a4-1c8c9e19dac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.627829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae83dba-8245-4f78-88a4-1c8c9e19dac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:19.629831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae83dba-8245-4f78-88a4-1c8c9e19dac8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:19.631359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8b7f5-f2f9-4a1f-a32b-8fecbac0c996 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:19.632761 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3fb8b7f5-f2f9-4a1f-a32b-8fecbac0c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:19.719335 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8b7f5-f2f9-4a1f-a32b-8fecbac0c996 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:19.723358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab640419-085e-4990-9a5f-cae5561c57c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6784d862961b44f48b385bec777ac439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:19.723941 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab640419-085e-4990-9a5f-cae5561c57c9 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.724234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab640419-085e-4990-9a5f-cae5561c57c9 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.724519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab640419-085e-4990-9a5f-cae5561c57c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.729096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1263/2531] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:19 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:23:19.730176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae83dba-8245-4f78-88a4-1c8c9e19dac8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:19.735832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bae83dba-8245-4f78-88a4-1c8c9e19dac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:19.737068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab640419-085e-4990-9a5f-cae5561c57c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:19.738659 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab640419-085e-4990-9a5f-cae5561c57c9 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:19.753796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1269/2532] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:23:19.754605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab640419-085e-4990-9a5f-cae5561c57c9 service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:19.770129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab640419-085e-4990-9a5f-cae5561c57c9 service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:19.775457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6b4c-b7af-4013-9090-8fedc7606798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:19.776524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6b4c-b7af-4013-9090-8fedc7606798 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.776936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6b4c-b7af-4013-9090-8fedc7606798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.777307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6b4c-b7af-4013-9090-8fedc7606798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.778460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd6b4c-b7af-4013-9090-8fedc7606798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:19.780172 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd6b4c-b7af-4013-9090-8fedc7606798 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:19.794845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1270/2533] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:19.797416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6b4c-b7af-4013-9090-8fedc7606798 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:19.807551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6b4c-b7af-4013-9090-8fedc7606798 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:19.810728 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:19.813815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838f219-87de-4661-a573-13db9b0c1e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:19.814623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838f219-87de-4661-a573-13db9b0c1e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.815038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838f219-87de-4661-a573-13db9b0c1e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.815324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838f219-87de-4661-a573-13db9b0c1e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.816195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838f219-87de-4661-a573-13db9b0c1e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:19.817944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838f219-87de-4661-a573-13db9b0c1e29 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:19.828107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae83dba-8245-4f78-88a4-1c8c9e19dac8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:19.833315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1271/2534] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:19.834310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98013dfb-d558-451f-a8cd-f5874a07702d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:19.834595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838f219-87de-4661-a573-13db9b0c1e29 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:19.834966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98013dfb-d558-451f-a8cd-f5874a07702d service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.835257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98013dfb-d558-451f-a8cd-f5874a07702d service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.835596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98013dfb-d558-451f-a8cd-f5874a07702d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.837475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-98013dfb-d558-451f-a8cd-f5874a07702d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:19.845919 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838f219-87de-4661-a573-13db9b0c1e29 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:19.854087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b98d5-9efc-49c6-8451-7ef11f93389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:19.854978 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b98d5-9efc-49c6-8451-7ef11f93389c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.855282 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b98d5-9efc-49c6-8451-7ef11f93389c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:19.855584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b98d5-9efc-49c6-8451-7ef11f93389c admin admin] PATH_INFO: `/v3/projects/1b657e66543548e09830f9ca3c4a40fd/users/9ca5b0b24c57448584eca943d4315b8d/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:19.856818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98013dfb-d558-451f-a8cd-f5874a07702d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:19.858279 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98013dfb-d558-451f-a8cd-f5874a07702d service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:19.870498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1264/2535] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:19.871764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b98d5-9efc-49c6-8451-7ef11f93389c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b657e66543548e09830f9ca3c4a40fd, user_id=9ca5b0b24c57448584eca943d4315b8d, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:19.874637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b98d5-9efc-49c6-8451-7ef11f93389c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:19.967611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:19.979994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1272/2536] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:19 2022] PUT /identity/v3/projects/1b657e66543548e09830f9ca3c4a40fd/users/9ca5b0b24c57448584eca943d4315b8d/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:19.989145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d1f3e-72a9-4be5-9694-a29b16a60711 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:19.991898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d1f3e-72a9-4be5-9694-a29b16a60711 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:20.000756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d1f3e-72a9-4be5-9694-a29b16a60711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:20.029027 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e28d1f3e-72a9-4be5-9694-a29b16a60711 None None] MFA Rules not processed for user `9ca5b0b24c57448584eca943d4315b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:20.031414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e28d1f3e-72a9-4be5-9694-a29b16a60711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:20.115904 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1265/2537] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:20.120309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b98d5-9efc-49c6-8451-7ef11f93389c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:20.190215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b98d5-9efc-49c6-8451-7ef11f93389c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:20.195593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7252f2a-807f-42a7-a25d-c11b661b08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:20.196384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7252f2a-807f-42a7-a25d-c11b661b08ba admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:20.196729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7252f2a-807f-42a7-a25d-c11b661b08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:20.197087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7252f2a-807f-42a7-a25d-c11b661b08ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:20.197875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7252f2a-807f-42a7-a25d-c11b661b08ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:20.200117 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7252f2a-807f-42a7-a25d-c11b661b08ba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:20.315915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1273/2538] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:20 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:20.318837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d1f3e-72a9-4be5-9694-a29b16a60711 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:20.329858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d1f3e-72a9-4be5-9694-a29b16a60711 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:20.391154 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1d41-959c-4c3a-aa08-62fe2e2bc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:20.392050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1d41-959c-4c3a-aa08-62fe2e2bc944 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:20.392439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1d41-959c-4c3a-aa08-62fe2e2bc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:20.392817 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1d41-959c-4c3a-aa08-62fe2e2bc944 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:20.393621 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1d41-959c-4c3a-aa08-62fe2e2bc944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:20.395665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1d41-959c-4c3a-aa08-62fe2e2bc944 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:20.506547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1266/2539] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:20 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:20.510746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7252f2a-807f-42a7-a25d-c11b661b08ba admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:20.522632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7252f2a-807f-42a7-a25d-c11b661b08ba admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:20.528352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50dff9-ea7e-4a34-ae98-faa3d1abe8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:20.529076 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50dff9-ea7e-4a34-ae98-faa3d1abe8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:20.529454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50dff9-ea7e-4a34-ae98-faa3d1abe8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:20.529734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50dff9-ea7e-4a34-ae98-faa3d1abe8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:20.530496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50dff9-ea7e-4a34-ae98-faa3d1abe8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:20.532887 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50dff9-ea7e-4a34-ae98-faa3d1abe8f2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:20.548588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1274/2540] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:20.550104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1d41-959c-4c3a-aa08-62fe2e2bc944 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:20.561072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1d41-959c-4c3a-aa08-62fe2e2bc944 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:20.566507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf81e3-33e0-4744-a674-2c3ca22882ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:20.575981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf81e3-33e0-4744-a674-2c3ca22882ec admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:20.580831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf81e3-33e0-4744-a674-2c3ca22882ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:20.580831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf81e3-33e0-4744-a674-2c3ca22882ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:20.580831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf81e3-33e0-4744-a674-2c3ca22882ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:20.580831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf81e3-33e0-4744-a674-2c3ca22882ec admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:20.597934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1267/2541] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:20.602329 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50dff9-ea7e-4a34-ae98-faa3d1abe8f2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:20.613922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50dff9-ea7e-4a34-ae98-faa3d1abe8f2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:20.618860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312412cb-4064-4a24-b917-1a063fb5ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:20.619778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312412cb-4064-4a24-b917-1a063fb5ad02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:20.620223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312412cb-4064-4a24-b917-1a063fb5ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:20.620507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312412cb-4064-4a24-b917-1a063fb5ad02 admin admin] PATH_INFO: `/v3/projects/301af9b865a14701be74d768b7713f2e/users/f5b3f15e57134949803da1060203234c/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:20.637167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312412cb-4064-4a24-b917-1a063fb5ad02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301af9b865a14701be74d768b7713f2e, user_id=f5b3f15e57134949803da1060203234c, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:20.639916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312412cb-4064-4a24-b917-1a063fb5ad02 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:20.716208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1275/2542] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:20 2022] PUT /identity/v3/projects/301af9b865a14701be74d768b7713f2e/users/f5b3f15e57134949803da1060203234c/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:20.726603 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eef59-b976-4eb3-a34d-e8678a3911d2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:20.726891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eef59-b976-4eb3-a34d-e8678a3911d2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:20.727168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eef59-b976-4eb3-a34d-e8678a3911d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:20.758034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f12eef59-b976-4eb3-a34d-e8678a3911d2 None None] MFA Rules not processed for user `f5b3f15e57134949803da1060203234c`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:20.759313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f12eef59-b976-4eb3-a34d-e8678a3911d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:20.811184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:20.853272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1268/2543] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:20.854515 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312412cb-4064-4a24-b917-1a063fb5ad02 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:20.915847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312412cb-4064-4a24-b917-1a063fb5ad02 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:20.920598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a03054-0b42-40bd-94cd-a3afcaaec8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:20.921259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a03054-0b42-40bd-94cd-a3afcaaec8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:20.921655 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a03054-0b42-40bd-94cd-a3afcaaec8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:20.921896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a03054-0b42-40bd-94cd-a3afcaaec8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:20.922601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a03054-0b42-40bd-94cd-a3afcaaec8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:20.924863 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a03054-0b42-40bd-94cd-a3afcaaec8bd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:21.039760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1276/2544] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:20 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:21.044151 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eef59-b976-4eb3-a34d-e8678a3911d2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:21.056426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eef59-b976-4eb3-a34d-e8678a3911d2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:21.128747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de6986-bb54-41cd-bb04-55415f7ebb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:21.128747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6986-bb54-41cd-bb04-55415f7ebb1b admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:21.128955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6986-bb54-41cd-bb04-55415f7ebb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:21.129181 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6986-bb54-41cd-bb04-55415f7ebb1b admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:21.129895 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de6986-bb54-41cd-bb04-55415f7ebb1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:21.131975 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de6986-bb54-41cd-bb04-55415f7ebb1b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:21.229039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1269/2545] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:21 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:21.230234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a03054-0b42-40bd-94cd-a3afcaaec8bd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:21.243251 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a03054-0b42-40bd-94cd-a3afcaaec8bd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:21.248295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d87f-3297-4efe-be9b-f53e60fdc432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:21.249072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d87f-3297-4efe-be9b-f53e60fdc432 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:21.251551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d87f-3297-4efe-be9b-f53e60fdc432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:21.251551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9d87f-3297-4efe-be9b-f53e60fdc432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:21.251916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9d87f-3297-4efe-be9b-f53e60fdc432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:21.253707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9d87f-3297-4efe-be9b-f53e60fdc432 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:21.266278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1277/2546] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:21.270469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de6986-bb54-41cd-bb04-55415f7ebb1b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:21.281056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de6986-bb54-41cd-bb04-55415f7ebb1b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:21.287130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025208-e9cf-42fa-af12-3bcaacb5e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:21.288159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025208-e9cf-42fa-af12-3bcaacb5e0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:21.294506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025208-e9cf-42fa-af12-3bcaacb5e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:21.294506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025208-e9cf-42fa-af12-3bcaacb5e0a1 admin admin] PATH_INFO: `/v3/projects/16152eb1c58447189f6b1af6ca95de54/users/34514309d8c34e9bb2f6941d7de1ad93/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:21.305839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025208-e9cf-42fa-af12-3bcaacb5e0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16152eb1c58447189f6b1af6ca95de54, user_id=34514309d8c34e9bb2f6941d7de1ad93, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:21.308556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025208-e9cf-42fa-af12-3bcaacb5e0a1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:21.412810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1270/2547] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:21 2022] PUT /identity/v3/projects/16152eb1c58447189f6b1af6ca95de54/users/34514309d8c34e9bb2f6941d7de1ad93/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:21.416862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d87f-3297-4efe-be9b-f53e60fdc432 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:21.428224 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9d87f-3297-4efe-be9b-f53e60fdc432 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:21.448002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:21.494269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689c65f-cabb-4a42-a6ea-c83b25e4cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:21.494947 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689c65f-cabb-4a42-a6ea-c83b25e4cb22 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:21.495234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689c65f-cabb-4a42-a6ea-c83b25e4cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:21.495521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689c65f-cabb-4a42-a6ea-c83b25e4cb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:21.496291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689c65f-cabb-4a42-a6ea-c83b25e4cb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:21.497895 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689c65f-cabb-4a42-a6ea-c83b25e4cb22 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:21.513936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1278/2548] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:21.518922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025208-e9cf-42fa-af12-3bcaacb5e0a1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:21.538017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025208-e9cf-42fa-af12-3bcaacb5e0a1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:21.543190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df59b-6b6b-4696-9080-6e4fd4699572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:21.544296 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df59b-6b6b-4696-9080-6e4fd4699572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:21.544672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df59b-6b6b-4696-9080-6e4fd4699572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:21.545028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df59b-6b6b-4696-9080-6e4fd4699572 admin admin] PATH_INFO: `/v3/projects/16152eb1c58447189f6b1af6ca95de54/users/34514309d8c34e9bb2f6941d7de1ad93/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:21.547668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df59b-6b6b-4696-9080-6e4fd4699572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16152eb1c58447189f6b1af6ca95de54, user_id=34514309d8c34e9bb2f6941d7de1ad93, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:21.551045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df59b-6b6b-4696-9080-6e4fd4699572 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:21.565226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1271/2549] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:21 2022] PUT /identity/v3/projects/16152eb1c58447189f6b1af6ca95de54/users/34514309d8c34e9bb2f6941d7de1ad93/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:21.577280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de235d1-aa73-47a8-98e5-cedefcee712d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:21.577753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de235d1-aa73-47a8-98e5-cedefcee712d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:21.578215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de235d1-aa73-47a8-98e5-cedefcee712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:21.607206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5de235d1-aa73-47a8-98e5-cedefcee712d None None] MFA Rules not processed for user `34514309d8c34e9bb2f6941d7de1ad93`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:21.608495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5de235d1-aa73-47a8-98e5-cedefcee712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:21.694705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1279/2550] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:21.706167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df59b-6b6b-4696-9080-6e4fd4699572 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:21.707971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f24df59b-6b6b-4696-9080-6e4fd4699572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:21.776339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df59b-6b6b-4696-9080-6e4fd4699572 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:21.777816 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e6756-495d-4f6e-ad7e-6b0637fb6830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:21.778688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e6756-495d-4f6e-ad7e-6b0637fb6830 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:21.779139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e6756-495d-4f6e-ad7e-6b0637fb6830 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:21.779567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e6756-495d-4f6e-ad7e-6b0637fb6830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:21.791568 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e6756-495d-4f6e-ad7e-6b0637fb6830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:21.793236 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e6756-495d-4f6e-ad7e-6b0637fb6830 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:21.805555 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1272/2551] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:21.933764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de235d1-aa73-47a8-98e5-cedefcee712d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:21.945004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de235d1-aa73-47a8-98e5-cedefcee712d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:21.953741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ec383-c26e-4552-872e-f339062c9aed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:21.954881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ec383-c26e-4552-872e-f339062c9aed service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:21.954881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ec383-c26e-4552-872e-f339062c9aed service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:21.955257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ec383-c26e-4552-872e-f339062c9aed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:22.047025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ec383-c26e-4552-872e-f339062c9aed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:22.051686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ec383-c26e-4552-872e-f339062c9aed service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:22.064256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1280/2552] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:23.771460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c5f1-3e5e-4d8c-abe6-e51fa5c09539 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:23.771967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c5f1-3e5e-4d8c-abe6-e51fa5c09539 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:23.772055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c5f1-3e5e-4d8c-abe6-e51fa5c09539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:23.791082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c754c5f1-3e5e-4d8c-abe6-e51fa5c09539 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:23.796557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c754c5f1-3e5e-4d8c-abe6-e51fa5c09539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:23.833089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:23.850504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1273/2553] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:23.863430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ec383-c26e-4552-872e-f339062c9aed service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:23.864988 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-065ec383-c26e-4552-872e-f339062c9aed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:23.913451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:23.936708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ec383-c26e-4552-872e-f339062c9aed service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:23.942347 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1598-3fe2-41b0-ba0d-d2b952aa7545 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:23.942943 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1598-3fe2-41b0-ba0d-d2b952aa7545 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:23.943229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1598-3fe2-41b0-ba0d-d2b952aa7545 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:23.943507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1598-3fe2-41b0-ba0d-d2b952aa7545 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:23.951620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b1598-3fe2-41b0-ba0d-d2b952aa7545 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:23.953860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b1598-3fe2-41b0-ba0d-d2b952aa7545 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:23.961807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1281/2554] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:23:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:23:26.432913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754c5f1-3e5e-4d8c-abe6-e51fa5c09539 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:26.520030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754c5f1-3e5e-4d8c-abe6-e51fa5c09539 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:26.525385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:26.526386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:26.526876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:26.527155 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] PATH_INFO: `/v3/users/9ca5b0b24c57448584eca943d4315b8d` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:26.528911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca5b0b24c57448584eca943d4315b8d)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:26.532524 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:26.759116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca5b0b24c57448584eca943d4315b8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:26.772984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca5b0b24c57448584eca943d4315b8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:26.845344 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca5b0b24c57448584eca943d4315b8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:26.846286 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca5b0b24c57448584eca943d4315b8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:26.869257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca5b0b24c57448584eca943d4315b8d'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:26.880768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1274/2555] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:26 2022] DELETE /identity/v3/users/9ca5b0b24c57448584eca943d4315b8d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:26.882285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af412154-e023-4ef6-b3db-f63597fef130 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:26.882772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af412154-e023-4ef6-b3db-f63597fef130 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:26.882876 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af412154-e023-4ef6-b3db-f63597fef130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:26.905024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af412154-e023-4ef6-b3db-f63597fef130 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:26.923436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af412154-e023-4ef6-b3db-f63597fef130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:27.011995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1282/2556] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:27.028856 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:27.033637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:27.186626 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883b533-fcc5-470a-b015-84e0e2c6eee1 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:27.193989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901c845-f038-4621-ae71-e348a7ddcd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:27.195703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901c845-f038-4621-ae71-e348a7ddcd4e service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:27.196187 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901c845-f038-4621-ae71-e348a7ddcd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:27.196608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901c845-f038-4621-ae71-e348a7ddcd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:27.220675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901c845-f038-4621-ae71-e348a7ddcd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:27.222635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901c845-f038-4621-ae71-e348a7ddcd4e service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:27.253489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1275/2557] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:28.374346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af412154-e023-4ef6-b3db-f63597fef130 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:28.375754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af412154-e023-4ef6-b3db-f63597fef130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:28.394729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af412154-e023-4ef6-b3db-f63597fef130 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:28.412883 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:28.413788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:28.414078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:28.414356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] PATH_INFO: `/v3/projects/1b657e66543548e09830f9ca3c4a40fd` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:28.415669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b657e66543548e09830f9ca3c4a40fd)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:28.417711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:28.667236 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b657e66543548e09830f9ca3c4a40fd', 'request_id': 'req-821c55d2-c9d2-4343-8379-351590ebbd07'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:28.762577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b657e66543548e09830f9ca3c4a40fd', 'request_id': 'req-821c55d2-c9d2-4343-8379-351590ebbd07'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:28.782126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b657e66543548e09830f9ca3c4a40fd', 'request_id': 'req-821c55d2-c9d2-4343-8379-351590ebbd07'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:28.813066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] The token cache is being invalidate because project 1b657e66543548e09830f9ca3c4a40fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:28.814814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:28.814814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:28.821113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901c845-f038-4621-ae71-e348a7ddcd4e service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:28.821704 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1283/2558] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:28 2022] DELETE /identity/v3/projects/1b657e66543548e09830f9ca3c4a40fd => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:28.834245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:28.847977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901c845-f038-4621-ae71-e348a7ddcd4e service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:28.967499 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:28.972099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:28.972099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:28.972099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] PATH_INFO: `/v3/users/f5b3f15e57134949803da1060203234c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:28.972099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b3f15e57134949803da1060203234c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:28.981064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:29.229152 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b3f15e57134949803da1060203234c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:29.231178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b3f15e57134949803da1060203234c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:29.303338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b3f15e57134949803da1060203234c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:29.306297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b3f15e57134949803da1060203234c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:29.323527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b3f15e57134949803da1060203234c'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:29.330394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1276/2559] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:28 2022] DELETE /identity/v3/users/f5b3f15e57134949803da1060203234c => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:29.523584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:29.529126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:29.551740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c55d2-c9d2-4343-8379-351590ebbd07 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:29.607954 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:29.616376 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:29.617270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:29.617680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:29.617966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] PATH_INFO: `/v3/users/7603d50657514c2d9e1ed22abccf972b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:29.619350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7603d50657514c2d9e1ed22abccf972b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:29.621589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:30.259191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7603d50657514c2d9e1ed22abccf972b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.266788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7603d50657514c2d9e1ed22abccf972b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.267526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7603d50657514c2d9e1ed22abccf972b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.279976 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7603d50657514c2d9e1ed22abccf972b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.290989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:30.292562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:30.309016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303119eb-3338-4848-8c35-854a6665183f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:30.314564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:30.320422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:30.320422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:30.320422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] PATH_INFO: `/v3/projects/301af9b865a14701be74d768b7713f2e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:30.320422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=301af9b865a14701be74d768b7713f2e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:30.320422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:30.396160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7603d50657514c2d9e1ed22abccf972b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.404350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1284/2560] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:29 2022] DELETE /identity/v3/users/7603d50657514c2d9e1ed22abccf972b => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:30.465476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301af9b865a14701be74d768b7713f2e', 'request_id': 'req-c236ca45-a0a2-4e98-816d-b95f6674e20f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.473718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301af9b865a14701be74d768b7713f2e', 'request_id': 'req-c236ca45-a0a2-4e98-816d-b95f6674e20f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.488875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301af9b865a14701be74d768b7713f2e', 'request_id': 'req-c236ca45-a0a2-4e98-816d-b95f6674e20f'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.590329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] The token cache is being invalidate because project 301af9b865a14701be74d768b7713f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:30.590702 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.591399 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:30.597032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1277/2561] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:30 2022] DELETE /identity/v3/projects/301af9b865a14701be74d768b7713f2e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:30.598271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:30.599699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:30.672996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18f92c-9ad7-41fb-a387-cced0e08c298 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:30.695069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:30.696696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:30.716298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:30.763086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:30.764009 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:30.764298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:30.764572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] PATH_INFO: `/v3/users/34514309d8c34e9bb2f6941d7de1ad93` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:30.766854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34514309d8c34e9bb2f6941d7de1ad93)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:30.769080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:30.799190 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ca45-a0a2-4e98-816d-b95f6674e20f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:30.805330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:30.806567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:30.806920 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:30.807208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] PATH_INFO: `/v3/projects/f9fefcc629a243e59351c96303395e2b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:30.808697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9fefcc629a243e59351c96303395e2b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:30.817464 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:30.817746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:31.011654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9fefcc629a243e59351c96303395e2b', 'request_id': 'req-c42c268b-7413-4416-bdc0-aecba5cce003'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.013306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34514309d8c34e9bb2f6941d7de1ad93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.019246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9fefcc629a243e59351c96303395e2b', 'request_id': 'req-c42c268b-7413-4416-bdc0-aecba5cce003'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.021447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34514309d8c34e9bb2f6941d7de1ad93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.022245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34514309d8c34e9bb2f6941d7de1ad93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.028126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9fefcc629a243e59351c96303395e2b', 'request_id': 'req-c42c268b-7413-4416-bdc0-aecba5cce003'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.035880 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34514309d8c34e9bb2f6941d7de1ad93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.147982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] The token cache is being invalidate because project f9fefcc629a243e59351c96303395e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:31.148284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.148910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.150843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1278/2562] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:30 2022] DELETE /identity/v3/projects/f9fefcc629a243e59351c96303395e2b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:31.159616 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:31.159616 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:31.235177 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34514309d8c34e9bb2f6941d7de1ad93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.245519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1285/2563] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:30 2022] DELETE /identity/v3/users/34514309d8c34e9bb2f6941d7de1ad93 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:31.263150 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c268b-7413-4416-bdc0-aecba5cce003 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:31.357866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:31.364130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:31.364130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:31.364130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] PATH_INFO: `/v3/users/c8e13f0777b244e39bb708bb9c2adfca` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:31.364130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e13f0777b244e39bb708bb9c2adfca)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:31.364130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:31.610871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e13f0777b244e39bb708bb9c2adfca'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.623088 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e13f0777b244e39bb708bb9c2adfca'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.688435 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:31.721550 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e13f0777b244e39bb708bb9c2adfca'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.722343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e13f0777b244e39bb708bb9c2adfca'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.732395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:31.735543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:31.742769 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-c5f2071f-ce18-45d4-97e2-a9326abf62a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e13f0777b244e39bb708bb9c2adfca'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:31.751186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e101ad-5001-4226-a904-4fce51108fc4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:31.756477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1279/2564] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:31 2022] DELETE /identity/v3/users/c8e13f0777b244e39bb708bb9c2adfca => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:31.766375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:31.767280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:31.767569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:31.767850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] PATH_INFO: `/v3/projects/16152eb1c58447189f6b1af6ca95de54` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:31.769332 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16152eb1c58447189f6b1af6ca95de54)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:31.771724 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:31.922570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16152eb1c58447189f6b1af6ca95de54', 'request_id': 'req-21fb9b48-96e4-445f-8519-999a381c5052'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.001580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16152eb1c58447189f6b1af6ca95de54', 'request_id': 'req-21fb9b48-96e4-445f-8519-999a381c5052'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.008555 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16152eb1c58447189f6b1af6ca95de54', 'request_id': 'req-21fb9b48-96e4-445f-8519-999a381c5052'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.019760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] The token cache is being invalidate because project 16152eb1c58447189f6b1af6ca95de54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:32.020021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.020649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.022216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1286/2565] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:31 2022] DELETE /identity/v3/projects/16152eb1c58447189f6b1af6ca95de54 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:32.029095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff878d4e-1ff0-4d49-aad5-0fea41ff15a3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.029397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff878d4e-1ff0-4d49-aad5-0fea41ff15a3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.029712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff878d4e-1ff0-4d49-aad5-0fea41ff15a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.049453 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:32.051082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:32.053948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ff878d4e-1ff0-4d49-aad5-0fea41ff15a3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:32.055323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ff878d4e-1ff0-4d49-aad5-0fea41ff15a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:32.146980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb9b48-96e4-445f-8519-999a381c5052 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:32.152762 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:32.153637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.153921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.154194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] PATH_INFO: `/v3/projects/3c893cec1115421c9600ceb921f12a12` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.155979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c893cec1115421c9600ceb921f12a12)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:32.158110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:32.168559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1280/2566] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:32.170386 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03425e-bf5f-44cf-9894-987992cfc4ea None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.170722 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03425e-bf5f-44cf-9894-987992cfc4ea None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.171240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03425e-bf5f-44cf-9894-987992cfc4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.198897 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3d03425e-bf5f-44cf-9894-987992cfc4ea None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:32.200259 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3d03425e-bf5f-44cf-9894-987992cfc4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:32.209280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1281/2567] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:32.215419 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03425e-bf5f-44cf-9894-987992cfc4ea None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:32.225813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03425e-bf5f-44cf-9894-987992cfc4ea None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:32.230572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b7d1e-d37f-4624-9e54-e6605609fd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:32.231245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b7d1e-d37f-4624-9e54-e6605609fd93 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.231533 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b7d1e-d37f-4624-9e54-e6605609fd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.231810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b7d1e-d37f-4624-9e54-e6605609fd93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.232697 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b7d1e-d37f-4624-9e54-e6605609fd93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:23:32.233044 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b7d1e-d37f-4624-9e54-e6605609fd93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:32.234629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b7d1e-d37f-4624-9e54-e6605609fd93 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:32.252538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1282/2568] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:23:32.255118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:32.256345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b7d1e-d37f-4624-9e54-e6605609fd93 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:32.267322 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b7d1e-d37f-4624-9e54-e6605609fd93 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:32.287333 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c893cec1115421c9600ceb921f12a12', 'request_id': 'req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.323987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:32.340949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecf02c-eb74-403f-bbcf-557775301f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:32.341629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecf02c-eb74-403f-bbcf-557775301f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.341910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecf02c-eb74-403f-bbcf-557775301f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.342185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecf02c-eb74-403f-bbcf-557775301f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.343549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecf02c-eb74-403f-bbcf-557775301f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:32.345575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecf02c-eb74-403f-bbcf-557775301f30 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:32.396279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c893cec1115421c9600ceb921f12a12', 'request_id': 'req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.404600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c893cec1115421c9600ceb921f12a12', 'request_id': 'req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.417278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] The token cache is being invalidate because project 3c893cec1115421c9600ceb921f12a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:32.417660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.418426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:32.420102 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1287/2569] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:32 2022] DELETE /identity/v3/projects/3c893cec1115421c9600ceb921f12a12 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:32.457645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1283/2570] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:32 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:32.459330 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:32.465083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:32.508725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb46a8e-3227-4b91-ab1d-81eb9b6585d3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:32.650647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765b3b3-7a9a-4ad6-91de-cdfdd0a2b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:32.651345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765b3b3-7a9a-4ad6-91de-cdfdd0a2b37d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.651628 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765b3b3-7a9a-4ad6-91de-cdfdd0a2b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.651950 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765b3b3-7a9a-4ad6-91de-cdfdd0a2b37d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.652657 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765b3b3-7a9a-4ad6-91de-cdfdd0a2b37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:32.654848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765b3b3-7a9a-4ad6-91de-cdfdd0a2b37d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:32.739381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1288/2571] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:32 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:32.743503 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecf02c-eb74-403f-bbcf-557775301f30 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:32.757502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecf02c-eb74-403f-bbcf-557775301f30 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:32.762604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa8de-9dac-433a-a914-4f03a1d76390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:32.763337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa8de-9dac-433a-a914-4f03a1d76390 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.763732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa8de-9dac-433a-a914-4f03a1d76390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.764092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aa8de-9dac-433a-a914-4f03a1d76390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.765748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aa8de-9dac-433a-a914-4f03a1d76390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:32.767382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aa8de-9dac-433a-a914-4f03a1d76390 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:32.779776 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1284/2572] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:32.784016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765b3b3-7a9a-4ad6-91de-cdfdd0a2b37d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:32.794696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765b3b3-7a9a-4ad6-91de-cdfdd0a2b37d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:32.800372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea8ece-2f69-40c4-82d4-9edc07dbfe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:32.801041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8ece-2f69-40c4-82d4-9edc07dbfe4a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.801358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8ece-2f69-40c4-82d4-9edc07dbfe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.801680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8ece-2f69-40c4-82d4-9edc07dbfe4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.802409 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea8ece-2f69-40c4-82d4-9edc07dbfe4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:32.804073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea8ece-2f69-40c4-82d4-9edc07dbfe4a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:32.815496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1289/2573] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:32.819572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa8de-9dac-433a-a914-4f03a1d76390 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:32.830481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aa8de-9dac-433a-a914-4f03a1d76390 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:32.835184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac358614-38b7-460c-a196-c14bcb19fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:32.836103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac358614-38b7-460c-a196-c14bcb19fe39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.836466 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac358614-38b7-460c-a196-c14bcb19fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.836745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac358614-38b7-460c-a196-c14bcb19fe39 admin admin] PATH_INFO: `/v3/projects/2c81ea92cf7744f49374f5e996955f76/users/7a22ab3a7c6948e897485c3df94afcc7/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.854134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac358614-38b7-460c-a196-c14bcb19fe39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c81ea92cf7744f49374f5e996955f76, user_id=7a22ab3a7c6948e897485c3df94afcc7, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:32.857237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac358614-38b7-460c-a196-c14bcb19fe39 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:32.943980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1285/2574] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:32 2022] PUT /identity/v3/projects/2c81ea92cf7744f49374f5e996955f76/users/7a22ab3a7c6948e897485c3df94afcc7/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:32.946481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5702361-b9a8-40ff-8723-8cf6fc7c7f72 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:32.946953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5702361-b9a8-40ff-8723-8cf6fc7c7f72 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:32.947316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5702361-b9a8-40ff-8723-8cf6fc7c7f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:32.975681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e5702361-b9a8-40ff-8723-8cf6fc7c7f72 None None] MFA Rules not processed for user `7a22ab3a7c6948e897485c3df94afcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:32.977070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e5702361-b9a8-40ff-8723-8cf6fc7c7f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:33.044443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1290/2575] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:33.049633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac358614-38b7-460c-a196-c14bcb19fe39 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:33.113876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac358614-38b7-460c-a196-c14bcb19fe39 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:33.118807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb93cf-5966-4c50-9acb-e5fdc0e212cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:33.119470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb93cf-5966-4c50-9acb-e5fdc0e212cf admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:33.119747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb93cf-5966-4c50-9acb-e5fdc0e212cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:33.120053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb93cf-5966-4c50-9acb-e5fdc0e212cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:33.120758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb93cf-5966-4c50-9acb-e5fdc0e212cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:33.122664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb93cf-5966-4c50-9acb-e5fdc0e212cf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:33.237131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1286/2576] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:33 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:33.241036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5702361-b9a8-40ff-8723-8cf6fc7c7f72 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:33.252678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5702361-b9a8-40ff-8723-8cf6fc7c7f72 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:33.272805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:33.311208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01dbe5-d42f-4230-8bf9-a7ad3836c342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:33.312563 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01dbe5-d42f-4230-8bf9-a7ad3836c342 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:33.312842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01dbe5-d42f-4230-8bf9-a7ad3836c342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:33.313292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01dbe5-d42f-4230-8bf9-a7ad3836c342 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:33.314103 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01dbe5-d42f-4230-8bf9-a7ad3836c342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:33.316462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01dbe5-d42f-4230-8bf9-a7ad3836c342 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:33.418546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1291/2577] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:33 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:33.422454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb93cf-5966-4c50-9acb-e5fdc0e212cf admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:33.433306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb93cf-5966-4c50-9acb-e5fdc0e212cf admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:33.438530 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a313b-35e9-4ae2-bc11-691abd9e722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:33.439210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a313b-35e9-4ae2-bc11-691abd9e722e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:33.439492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a313b-35e9-4ae2-bc11-691abd9e722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:33.439813 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a313b-35e9-4ae2-bc11-691abd9e722e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:33.440565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a313b-35e9-4ae2-bc11-691abd9e722e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:33.444723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a313b-35e9-4ae2-bc11-691abd9e722e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:33.453604 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1287/2578] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:23:33.457900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01dbe5-d42f-4230-8bf9-a7ad3836c342 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:33.467984 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01dbe5-d42f-4230-8bf9-a7ad3836c342 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:33.473242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f9b0a-ae4c-4505-ba90-61ae9906fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:33.479187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9b0a-ae4c-4505-ba90-61ae9906fbf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:33.479187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9b0a-ae4c-4505-ba90-61ae9906fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:33.479187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9b0a-ae4c-4505-ba90-61ae9906fbf2 admin admin] PATH_INFO: `/v3/projects/ed83c23c277a48e1af7da8876f9b5fee/users/b8865909e1654a5ca52c4d408d9b1553/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:33.489958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f9b0a-ae4c-4505-ba90-61ae9906fbf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed83c23c277a48e1af7da8876f9b5fee, user_id=b8865909e1654a5ca52c4d408d9b1553, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:33.492686 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f9b0a-ae4c-4505-ba90-61ae9906fbf2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:33.566381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1292/2579] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:33 2022] PUT /identity/v3/projects/ed83c23c277a48e1af7da8876f9b5fee/users/b8865909e1654a5ca52c4d408d9b1553/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:33.570297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a313b-35e9-4ae2-bc11-691abd9e722e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:33.580382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a313b-35e9-4ae2-bc11-691abd9e722e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:33.641896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986ed1-0069-4241-a2d3-b8bb9fe5e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:33.642873 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986ed1-0069-4241-a2d3-b8bb9fe5e82b admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:33.643160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986ed1-0069-4241-a2d3-b8bb9fe5e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:33.643442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986ed1-0069-4241-a2d3-b8bb9fe5e82b admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:33.644300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e986ed1-0069-4241-a2d3-b8bb9fe5e82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:33.645921 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e986ed1-0069-4241-a2d3-b8bb9fe5e82b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:33.656506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1288/2580] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:33.660664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f9b0a-ae4c-4505-ba90-61ae9906fbf2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:33.678325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f9b0a-ae4c-4505-ba90-61ae9906fbf2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:33.678325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715694-5a8d-4197-9742-0d1b4f6d553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:33.679298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715694-5a8d-4197-9742-0d1b4f6d553f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:33.679641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715694-5a8d-4197-9742-0d1b4f6d553f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:33.680021 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0715694-5a8d-4197-9742-0d1b4f6d553f admin admin] PATH_INFO: `/v3/projects/ed83c23c277a48e1af7da8876f9b5fee/users/b8865909e1654a5ca52c4d408d9b1553/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:33.681991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0715694-5a8d-4197-9742-0d1b4f6d553f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed83c23c277a48e1af7da8876f9b5fee, user_id=b8865909e1654a5ca52c4d408d9b1553, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:33.684813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0715694-5a8d-4197-9742-0d1b4f6d553f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:33.697049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1293/2581] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:33 2022] PUT /identity/v3/projects/ed83c23c277a48e1af7da8876f9b5fee/users/b8865909e1654a5ca52c4d408d9b1553/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:33.708792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955a08c-0bea-4bba-bd93-84f48bf11bb8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:33.709085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955a08c-0bea-4bba-bd93-84f48bf11bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:33.709362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955a08c-0bea-4bba-bd93-84f48bf11bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:33.716668 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:33.738306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-0955a08c-0bea-4bba-bd93-84f48bf11bb8 None None] MFA Rules not processed for user `b8865909e1654a5ca52c4d408d9b1553`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:33.739596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-0955a08c-0bea-4bba-bd93-84f48bf11bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:33.808881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1289/2582] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:23:33.820543 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715694-5a8d-4197-9742-0d1b4f6d553f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:33.822342 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d0715694-5a8d-4197-9742-0d1b4f6d553f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:33.881857 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0715694-5a8d-4197-9742-0d1b4f6d553f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:33.885521 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb29d9-e1b2-4a48-9317-613de4f8173d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:33.886170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb29d9-e1b2-4a48-9317-613de4f8173d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:33.886454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb29d9-e1b2-4a48-9317-613de4f8173d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:33.886733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb29d9-e1b2-4a48-9317-613de4f8173d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:33.943025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb29d9-e1b2-4a48-9317-613de4f8173d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:33.944446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb29d9-e1b2-4a48-9317-613de4f8173d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:33.953482 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1294/2583] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:40.237949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955a08c-0bea-4bba-bd93-84f48bf11bb8 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:40.247661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955a08c-0bea-4bba-bd93-84f48bf11bb8 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:40.251387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fd1be-6759-4a5a-a046-813ce9289caf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:40.252109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fd1be-6759-4a5a-a046-813ce9289caf service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:40.252388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fd1be-6759-4a5a-a046-813ce9289caf service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:40.252661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fd1be-6759-4a5a-a046-813ce9289caf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:40.261747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fd1be-6759-4a5a-a046-813ce9289caf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:40.263160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fd1be-6759-4a5a-a046-813ce9289caf service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:40.273454 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1290/2584] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:43.949271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:46.318609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb29d9-e1b2-4a48-9317-613de4f8173d service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:46.384065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb29d9-e1b2-4a48-9317-613de4f8173d service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:46.384740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:46.385605 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:46.385890 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:46.386167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] PATH_INFO: `/v3/users/7a22ab3a7c6948e897485c3df94afcc7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:46.387346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a22ab3a7c6948e897485c3df94afcc7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:46.389325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:46.618943 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a22ab3a7c6948e897485c3df94afcc7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:46.625902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a22ab3a7c6948e897485c3df94afcc7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:46.627139 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a22ab3a7c6948e897485c3df94afcc7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:46.638867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a22ab3a7c6948e897485c3df94afcc7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:46.719569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a22ab3a7c6948e897485c3df94afcc7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:46.726103 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1295/2585] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:46 2022] DELETE /identity/v3/users/7a22ab3a7c6948e897485c3df94afcc7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:46.730712 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc60da4-5479-4ac7-b3db-58d71313f8a6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:46.731207 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc60da4-5479-4ac7-b3db-58d71313f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:46.731305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc60da4-5479-4ac7-b3db-58d71313f8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:46.749250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-bbc60da4-5479-4ac7-b3db-58d71313f8a6 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:46.750452 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bbc60da4-5479-4ac7-b3db-58d71313f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:46.814385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1291/2586] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:46.825277 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:46.826676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:46.901953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441990d-0950-4cb6-bb4d-abbf974b83f6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:46.905663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612f45-2e9c-4e62-84e2-655674d4288d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:46.906311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612f45-2e9c-4e62-84e2-655674d4288d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:46.906595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612f45-2e9c-4e62-84e2-655674d4288d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:46.906872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612f45-2e9c-4e62-84e2-655674d4288d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:46.919441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612f45-2e9c-4e62-84e2-655674d4288d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:46.922011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612f45-2e9c-4e62-84e2-655674d4288d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:46.934162 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1296/2587] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:23:47.472284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc60da4-5479-4ac7-b3db-58d71313f8a6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:47.474059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bbc60da4-5479-4ac7-b3db-58d71313f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:47.491448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc60da4-5479-4ac7-b3db-58d71313f8a6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:47.502884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:47.502884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:47.502884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:47.502884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] PATH_INFO: `/v3/projects/2c81ea92cf7744f49374f5e996955f76` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:47.503252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c81ea92cf7744f49374f5e996955f76)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:47.503252 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:47.613912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c81ea92cf7744f49374f5e996955f76', 'request_id': 'req-6867ed16-3428-45a5-9936-be954773333e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:47.620505 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c81ea92cf7744f49374f5e996955f76', 'request_id': 'req-6867ed16-3428-45a5-9936-be954773333e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:47.626081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c81ea92cf7744f49374f5e996955f76', 'request_id': 'req-6867ed16-3428-45a5-9936-be954773333e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:47.728327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:47.732099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] The token cache is being invalidate because project 2c81ea92cf7744f49374f5e996955f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:47.732677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:47.733030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-6867ed16-3428-45a5-9936-be954773333e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:47.734675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1292/2588] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:47 2022] DELETE /identity/v3/projects/2c81ea92cf7744f49374f5e996955f76 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:47.738845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612f45-2e9c-4e62-84e2-655674d4288d service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:47.748651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612f45-2e9c-4e62-84e2-655674d4288d service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:47.766799 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:47.806206 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:47.807068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:47.807385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:47.807664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] PATH_INFO: `/v3/users/b8865909e1654a5ca52c4d408d9b1553` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:47.808885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8865909e1654a5ca52c4d408d9b1553)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:47.810811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:47.993414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee781f-cb38-4eec-8256-b67dd4cc8bc4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:47.993705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee781f-cb38-4eec-8256-b67dd4cc8bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:47.993982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee781f-cb38-4eec-8256-b67dd4cc8bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:48.016012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8865909e1654a5ca52c4d408d9b1553'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:48.017496 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f4ee781f-cb38-4eec-8256-b67dd4cc8bc4 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:48.019069 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f4ee781f-cb38-4eec-8256-b67dd4cc8bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:48.023428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8865909e1654a5ca52c4d408d9b1553'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:48.024163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8865909e1654a5ca52c4d408d9b1553'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:48.036875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8865909e1654a5ca52c4d408d9b1553'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:48.076725 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1293/2589] 10.222.0.49 () {58 vars in 967 bytes} [Tue Jun 28 12:23:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:23:48.091237 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee781f-cb38-4eec-8256-b67dd4cc8bc4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:48.092655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f4ee781f-cb38-4eec-8256-b67dd4cc8bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:48.103833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8865909e1654a5ca52c4d408d9b1553'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:48.111379 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1297/2590] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:47 2022] DELETE /identity/v3/users/b8865909e1654a5ca52c4d408d9b1553 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:48.183584 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee781f-cb38-4eec-8256-b67dd4cc8bc4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:48.252441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0dd0f0-3ba9-476a-aa15-ee4848264048 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:48.252808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dd0f0-3ba9-476a-aa15-ee4848264048 service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:48.253090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dd0f0-3ba9-476a-aa15-ee4848264048 service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:48.253364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0dd0f0-3ba9-476a-aa15-ee4848264048 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:48.255182 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cf0dd0f0-3ba9-476a-aa15-ee4848264048 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:48.302073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:48.312128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0dd0f0-3ba9-476a-aa15-ee4848264048 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:48.313784 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0dd0f0-3ba9-476a-aa15-ee4848264048 service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:48.322405 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1294/2591] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:23:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 12:23:48.652267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:48.662415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:48.724652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f9671-58c6-4a29-bef2-b61a812b3128 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:48.729307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:48.730179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:48.730466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:48.730749 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] PATH_INFO: `/v3/projects/ed83c23c277a48e1af7da8876f9b5fee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:48.731982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed83c23c277a48e1af7da8876f9b5fee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:48.733894 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:48.890722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:48.893341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed83c23c277a48e1af7da8876f9b5fee', 'request_id': 'req-6741b499-277b-4f11-bbd0-666b057a50f5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:48.996286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed83c23c277a48e1af7da8876f9b5fee', 'request_id': 'req-6741b499-277b-4f11-bbd0-666b057a50f5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:49.003589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed83c23c277a48e1af7da8876f9b5fee', 'request_id': 'req-6741b499-277b-4f11-bbd0-666b057a50f5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:49.019059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] The token cache is being invalidate because project ed83c23c277a48e1af7da8876f9b5fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:49.019594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:49.020269 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6741b499-277b-4f11-bbd0-666b057a50f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:49.021820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1298/2592] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:48 2022] DELETE /identity/v3/projects/ed83c23c277a48e1af7da8876f9b5fee => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:49.029100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45165b-49a4-4f76-b769-c6388d79c7d2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:49.029100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45165b-49a4-4f76-b769-c6388d79c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:49.029100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45165b-49a4-4f76-b769-c6388d79c7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:49.050761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-7c45165b-49a4-4f76-b769-c6388d79c7d2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:49.050761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7c45165b-49a4-4f76-b769-c6388d79c7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:49.116503 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1295/2593] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:49.124488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583ac6c-8cbd-46aa-8d5f-1511bebab272 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:49.124855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583ac6c-8cbd-46aa-8d5f-1511bebab272 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:49.125232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583ac6c-8cbd-46aa-8d5f-1511bebab272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:49.147043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e583ac6c-8cbd-46aa-8d5f-1511bebab272 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:49.149487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e583ac6c-8cbd-46aa-8d5f-1511bebab272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:49.159017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1299/2594] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:49.163377 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45165b-49a4-4f76-b769-c6388d79c7d2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:49.174522 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45165b-49a4-4f76-b769-c6388d79c7d2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:49.179632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6a02a-308f-46ed-9508-6f190b1e1f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:49.180416 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6a02a-308f-46ed-9508-6f190b1e1f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:49.180770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6a02a-308f-46ed-9508-6f190b1e1f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:49.181054 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6a02a-308f-46ed-9508-6f190b1e1f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:49.181787 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6a02a-308f-46ed-9508-6f190b1e1f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:23:49.182216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6a02a-308f-46ed-9508-6f190b1e1f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:49.183799 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6a02a-308f-46ed-9508-6f190b1e1f14 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:49.197667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1296/2595] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:23:49.202220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583ac6c-8cbd-46aa-8d5f-1511bebab272 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:49.213860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583ac6c-8cbd-46aa-8d5f-1511bebab272 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:49.221318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e18b43-eb3c-4970-8a9b-c9199ca8c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:49.221983 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e18b43-eb3c-4970-8a9b-c9199ca8c9cc admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:49.222270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e18b43-eb3c-4970-8a9b-c9199ca8c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:49.222582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e18b43-eb3c-4970-8a9b-c9199ca8c9cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:49.223230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e18b43-eb3c-4970-8a9b-c9199ca8c9cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:49.225183 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e18b43-eb3c-4970-8a9b-c9199ca8c9cc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:49.347382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1300/2596] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:49 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:49.352034 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6a02a-308f-46ed-9508-6f190b1e1f14 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:49.365687 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6a02a-308f-46ed-9508-6f190b1e1f14 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:49.425232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e59ef-544c-4db1-ab00-61d9e324df94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:49.425912 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e59ef-544c-4db1-ab00-61d9e324df94 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:49.426198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e59ef-544c-4db1-ab00-61d9e324df94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:49.426477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e59ef-544c-4db1-ab00-61d9e324df94 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:49.427166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e59ef-544c-4db1-ab00-61d9e324df94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:49.429129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e59ef-544c-4db1-ab00-61d9e324df94 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:49.553019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1297/2597] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:49 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:23:49.554535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e18b43-eb3c-4970-8a9b-c9199ca8c9cc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:49.565635 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e18b43-eb3c-4970-8a9b-c9199ca8c9cc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:49.570222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d00b6-eef2-4534-ab76-11c84f080eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:49.570991 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d00b6-eef2-4534-ab76-11c84f080eae admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:49.571220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d00b6-eef2-4534-ab76-11c84f080eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:49.571498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d00b6-eef2-4534-ab76-11c84f080eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:49.572262 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d00b6-eef2-4534-ab76-11c84f080eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:49.583283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d00b6-eef2-4534-ab76-11c84f080eae admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:49.589830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1301/2598] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:49.590991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e59ef-544c-4db1-ab00-61d9e324df94 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:49.602781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e59ef-544c-4db1-ab00-61d9e324df94 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:49.607737 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7f65c-7ded-4192-bf1a-9e3f632efaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:49.608692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f65c-7ded-4192-bf1a-9e3f632efaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:49.609114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f65c-7ded-4192-bf1a-9e3f632efaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:49.609493 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7f65c-7ded-4192-bf1a-9e3f632efaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:49.610513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7f65c-7ded-4192-bf1a-9e3f632efaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:49.612990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7f65c-7ded-4192-bf1a-9e3f632efaf6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:49.627759 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1298/2599] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:49.629662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d00b6-eef2-4534-ab76-11c84f080eae admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:49.639690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d00b6-eef2-4534-ab76-11c84f080eae admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:49.644593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e77ee-98ee-47c6-833e-c8a98d1a3e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:49.645530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e77ee-98ee-47c6-833e-c8a98d1a3e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:49.645820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e77ee-98ee-47c6-833e-c8a98d1a3e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:49.646687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e77ee-98ee-47c6-833e-c8a98d1a3e68 admin admin] PATH_INFO: `/v3/projects/1e85ef841d2242f284f3ddc49156b508/users/eae7b295ee0e4a4099bad2924b1e3bc6/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:49.663620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e77ee-98ee-47c6-833e-c8a98d1a3e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e85ef841d2242f284f3ddc49156b508, user_id=eae7b295ee0e4a4099bad2924b1e3bc6, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:49.666378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e77ee-98ee-47c6-833e-c8a98d1a3e68 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:49.767372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1302/2600] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:49 2022] PUT /identity/v3/projects/1e85ef841d2242f284f3ddc49156b508/users/eae7b295ee0e4a4099bad2924b1e3bc6/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:23:49.787233 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be90a1-a6df-4ba9-9c1e-985edd31943d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:49.787623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be90a1-a6df-4ba9-9c1e-985edd31943d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:49.788038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be90a1-a6df-4ba9-9c1e-985edd31943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:49.824847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-76be90a1-a6df-4ba9-9c1e-985edd31943d None None] MFA Rules not processed for user `eae7b295ee0e4a4099bad2924b1e3bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:49.826246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-76be90a1-a6df-4ba9-9c1e-985edd31943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:49.881293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:49.905612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1299/2601] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:49.921997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e77ee-98ee-47c6-833e-c8a98d1a3e68 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:49.925588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e4e77ee-98ee-47c6-833e-c8a98d1a3e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:50.009786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e77ee-98ee-47c6-833e-c8a98d1a3e68 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:50.013756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331467ad-5aa1-4ec9-9aa6-02a5b543a940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:50.014588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331467ad-5aa1-4ec9-9aa6-02a5b543a940 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:50.014875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331467ad-5aa1-4ec9-9aa6-02a5b543a940 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:50.015171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331467ad-5aa1-4ec9-9aa6-02a5b543a940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:50.026108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331467ad-5aa1-4ec9-9aa6-02a5b543a940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:50.027564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331467ad-5aa1-4ec9-9aa6-02a5b543a940 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:50.039442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1303/2602] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:50.059889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be90a1-a6df-4ba9-9c1e-985edd31943d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:50.128085 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be90a1-a6df-4ba9-9c1e-985edd31943d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:50.133330 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:50.134209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:50.134485 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:50.134756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] PATH_INFO: `/v3/users/eae7b295ee0e4a4099bad2924b1e3bc6` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:50.135986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae7b295ee0e4a4099bad2924b1e3bc6)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:50.137923 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:50.362839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae7b295ee0e4a4099bad2924b1e3bc6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:50.370601 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae7b295ee0e4a4099bad2924b1e3bc6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:50.435073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae7b295ee0e4a4099bad2924b1e3bc6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:50.436084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae7b295ee0e4a4099bad2924b1e3bc6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:50.453206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae7b295ee0e4a4099bad2924b1e3bc6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:50.463149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1300/2603] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:23:50 2022] DELETE /identity/v3/users/eae7b295ee0e4a4099bad2924b1e3bc6 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:50.469577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847e2b3-b48d-452d-81b2-e1bc85587c3a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:50.470316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847e2b3-b48d-452d-81b2-e1bc85587c3a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:50.470455 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847e2b3-b48d-452d-81b2-e1bc85587c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:50.503548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0847e2b3-b48d-452d-81b2-e1bc85587c3a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:50.503548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0847e2b3-b48d-452d-81b2-e1bc85587c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:50.591639 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1304/2604] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:50.609628 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:50.611723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:50.674124 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c7e55-210e-48ef-8425-9461c5a77fae admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:50.677991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db9620-1ccc-4bb9-9bc4-aeafa12b4fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:50.678649 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db9620-1ccc-4bb9-9bc4-aeafa12b4fae service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:50.678997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db9620-1ccc-4bb9-9bc4-aeafa12b4fae service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:50.679212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db9620-1ccc-4bb9-9bc4-aeafa12b4fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:50.690111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db9620-1ccc-4bb9-9bc4-aeafa12b4fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:50.691833 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db9620-1ccc-4bb9-9bc4-aeafa12b4fae service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:50.702889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1301/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:51.110700 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847e2b3-b48d-452d-81b2-e1bc85587c3a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:51.112307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0847e2b3-b48d-452d-81b2-e1bc85587c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:51.124433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847e2b3-b48d-452d-81b2-e1bc85587c3a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:51.130027 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:51.130880 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.131170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.131450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] PATH_INFO: `/v3/projects/1e85ef841d2242f284f3ddc49156b508` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:51.132690 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e85ef841d2242f284f3ddc49156b508)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:51.134621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:51.142819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:51.227503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e85ef841d2242f284f3ddc49156b508', 'request_id': 'req-6013693d-267e-46b9-a961-1162903a9def'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:51.286163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e85ef841d2242f284f3ddc49156b508', 'request_id': 'req-6013693d-267e-46b9-a961-1162903a9def'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:51.292725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e85ef841d2242f284f3ddc49156b508', 'request_id': 'req-6013693d-267e-46b9-a961-1162903a9def'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:51.303518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] The token cache is being invalidate because project 1e85ef841d2242f284f3ddc49156b508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:23:51.303808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:51.304469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6013693d-267e-46b9-a961-1162903a9def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:23:51.306002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1305/2606] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:23:51 2022] DELETE /identity/v3/projects/1e85ef841d2242f284f3ddc49156b508 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:51.310864 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb129b-466f-42f1-a207-203403b9ae22 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.311357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb129b-466f-42f1-a207-203403b9ae22 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.311466 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb129b-466f-42f1-a207-203403b9ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:51.329783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:51.336262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-dfdb129b-466f-42f1-a207-203403b9ae22 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:51.337513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-dfdb129b-466f-42f1-a207-203403b9ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:51.394809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1302/2607] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:51.403305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52393eab-dda3-41f0-97e7-60babe389b49 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.403601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52393eab-dda3-41f0-97e7-60babe389b49 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.404695 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52393eab-dda3-41f0-97e7-60babe389b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:51.422208 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-52393eab-dda3-41f0-97e7-60babe389b49 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:51.423678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-52393eab-dda3-41f0-97e7-60babe389b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:51.432510 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1306/2608] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:51.436570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb129b-466f-42f1-a207-203403b9ae22 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:51.446718 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb129b-466f-42f1-a207-203403b9ae22 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:51.451394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b11685-90d7-4641-a764-a22902d579ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:51.456355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11685-90d7-4641-a764-a22902d579ba admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.456355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11685-90d7-4641-a764-a22902d579ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.456355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b11685-90d7-4641-a764-a22902d579ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:51.456355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b11685-90d7-4641-a764-a22902d579ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:23:51.456355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b11685-90d7-4641-a764-a22902d579ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:51.456355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b11685-90d7-4641-a764-a22902d579ba admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:51.466556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1303/2609] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:23:51.470948 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52393eab-dda3-41f0-97e7-60babe389b49 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:51.480644 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52393eab-dda3-41f0-97e7-60babe389b49 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:51.485371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6950b82-c2b8-45d4-a2ff-aa37bc43f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:51.486017 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6950b82-c2b8-45d4-a2ff-aa37bc43f4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.486307 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6950b82-c2b8-45d4-a2ff-aa37bc43f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.486589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6950b82-c2b8-45d4-a2ff-aa37bc43f4e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:51.487285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6950b82-c2b8-45d4-a2ff-aa37bc43f4e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:51.489920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6950b82-c2b8-45d4-a2ff-aa37bc43f4e4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:51.579313 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1307/2610] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:23:51 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:23:51.583744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b11685-90d7-4641-a764-a22902d579ba admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:51.594038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b11685-90d7-4641-a764-a22902d579ba admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:51.649781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7899f-a122-4be5-a3b9-df01be63a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:51.650375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7899f-a122-4be5-a3b9-df01be63a15e admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.650661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7899f-a122-4be5-a3b9-df01be63a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.650937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7899f-a122-4be5-a3b9-df01be63a15e admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:51.651637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7899f-a122-4be5-a3b9-df01be63a15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:51.653598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7899f-a122-4be5-a3b9-df01be63a15e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:51.760992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1304/2611] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:23:51 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:23:51.765002 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6950b82-c2b8-45d4-a2ff-aa37bc43f4e4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:51.775255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6950b82-c2b8-45d4-a2ff-aa37bc43f4e4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:51.779786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4799a7-6126-47f2-9b7a-a520b6cfe5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:51.780465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4799a7-6126-47f2-9b7a-a520b6cfe5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.780788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4799a7-6126-47f2-9b7a-a520b6cfe5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.781066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4799a7-6126-47f2-9b7a-a520b6cfe5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:51.781790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4799a7-6126-47f2-9b7a-a520b6cfe5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:51.783368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4799a7-6126-47f2-9b7a-a520b6cfe5e1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:51.794089 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1308/2612] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:51.797978 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7899f-a122-4be5-a3b9-df01be63a15e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:51.809378 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7899f-a122-4be5-a3b9-df01be63a15e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:51.813971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35ecab-ed27-4c6a-9f66-e70a3590bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:51.814641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35ecab-ed27-4c6a-9f66-e70a3590bfdc admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.814929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35ecab-ed27-4c6a-9f66-e70a3590bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.815204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35ecab-ed27-4c6a-9f66-e70a3590bfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:51.816064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35ecab-ed27-4c6a-9f66-e70a3590bfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:51.817654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35ecab-ed27-4c6a-9f66-e70a3590bfdc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:51.827596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1305/2613] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:23:51.831840 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4799a7-6126-47f2-9b7a-a520b6cfe5e1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:51.841609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4799a7-6126-47f2-9b7a-a520b6cfe5e1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:51.846088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9cb7-a1a7-4651-ae0b-9e9ddf4d5f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:51.847450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9cb7-a1a7-4651-ae0b-9e9ddf4d5f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.847723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9cb7-a1a7-4651-ae0b-9e9ddf4d5f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.848034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9cb7-a1a7-4651-ae0b-9e9ddf4d5f3d admin admin] PATH_INFO: `/v3/projects/50d11d9b8faf4d93b6b61e3028d837bd/users/3b71e63e78264a2d9f51fb5953563ba0/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:51.862294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c9cb7-a1a7-4651-ae0b-9e9ddf4d5f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d11d9b8faf4d93b6b61e3028d837bd, user_id=3b71e63e78264a2d9f51fb5953563ba0, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:51.865601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c9cb7-a1a7-4651-ae0b-9e9ddf4d5f3d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:51.967065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1309/2614] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:23:51 2022] PUT /identity/v3/projects/50d11d9b8faf4d93b6b61e3028d837bd/users/3b71e63e78264a2d9f51fb5953563ba0/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:23:51.979893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028018c1-8aad-4d28-a2d7-4126fa308bed None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:51.980320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028018c1-8aad-4d28-a2d7-4126fa308bed None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:51.980609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028018c1-8aad-4d28-a2d7-4126fa308bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:52.007536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-028018c1-8aad-4d28-a2d7-4126fa308bed None None] MFA Rules not processed for user `3b71e63e78264a2d9f51fb5953563ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:23:52.008834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-028018c1-8aad-4d28-a2d7-4126fa308bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:52.077593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1306/2615] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:23:52.088318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9cb7-a1a7-4651-ae0b-9e9ddf4d5f3d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:52.090143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4d2c9cb7-a1a7-4651-ae0b-9e9ddf4d5f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:52.153609 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9cb7-a1a7-4651-ae0b-9e9ddf4d5f3d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:52.157283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640a0e-dfa3-4b66-a72a-4ccfa2ae300d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:52.157958 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640a0e-dfa3-4b66-a72a-4ccfa2ae300d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:52.158240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640a0e-dfa3-4b66-a72a-4ccfa2ae300d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:52.158518 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640a0e-dfa3-4b66-a72a-4ccfa2ae300d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:52.167843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6640a0e-dfa3-4b66-a72a-4ccfa2ae300d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:52.169231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6640a0e-dfa3-4b66-a72a-4ccfa2ae300d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:52.179205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1310/2616] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:23:56.908732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028018c1-8aad-4d28-a2d7-4126fa308bed None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:23:56.910861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-028018c1-8aad-4d28-a2d7-4126fa308bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:56.915990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:23:56.966257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028018c1-8aad-4d28-a2d7-4126fa308bed None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:23:56.969804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04161fe3-a03f-4b3e-9ff7-5cf1442fca4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:23:56.970490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04161fe3-a03f-4b3e-9ff7-5cf1442fca4b service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:23:56.970766 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04161fe3-a03f-4b3e-9ff7-5cf1442fca4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:23:56.971039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04161fe3-a03f-4b3e-9ff7-5cf1442fca4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:23:56.973447 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-04161fe3-a03f-4b3e-9ff7-5cf1442fca4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:23:57.035692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04161fe3-a03f-4b3e-9ff7-5cf1442fca4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:23:57.037146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04161fe3-a03f-4b3e-9ff7-5cf1442fca4b service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:23:57.046662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1307/2617] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:00.955056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640a0e-dfa3-4b66-a72a-4ccfa2ae300d service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:00.956682 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e6640a0e-dfa3-4b66-a72a-4ccfa2ae300d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:00.972616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640a0e-dfa3-4b66-a72a-4ccfa2ae300d service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:00.977231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:00.978101 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:00.978388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:00.978672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] PATH_INFO: `/v3/users/4174d5226c454de9bd67dbce1aade939` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:00.993440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4174d5226c454de9bd67dbce1aade939)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:00.995408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:01.012274 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:01.174435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4174d5226c454de9bd67dbce1aade939'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.182006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4174d5226c454de9bd67dbce1aade939'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.182663 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4174d5226c454de9bd67dbce1aade939'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.198564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4174d5226c454de9bd67dbce1aade939'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.262231 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a452849b-8cbc-4940-9998-0b4ab0014567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4174d5226c454de9bd67dbce1aade939'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.268703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1311/2618] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:00 2022] DELETE /identity/v3/users/4174d5226c454de9bd67dbce1aade939 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:01.552780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04161fe3-a03f-4b3e-9ff7-5cf1442fca4b service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:01.562855 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04161fe3-a03f-4b3e-9ff7-5cf1442fca4b service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:01.622109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:01.622970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:01.623329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:01.623607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] PATH_INFO: `/v3/projects/1bff7879d58c46739abd203f34c921e3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:01.634600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bff7879d58c46739abd203f34c921e3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:01.636707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:01.728866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:01.731622 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bff7879d58c46739abd203f34c921e3', 'request_id': 'req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.738954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bff7879d58c46739abd203f34c921e3', 'request_id': 'req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.745026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bff7879d58c46739abd203f34c921e3', 'request_id': 'req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.810310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] The token cache is being invalidate because project 1bff7879d58c46739abd203f34c921e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:01.810536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.811149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e4e1cc78-97c9-40d3-bb4b-aaa043d460bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:01.812824 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1308/2619] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:01 2022] DELETE /identity/v3/projects/1bff7879d58c46739abd203f34c921e3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:24:01.818094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98506d-080e-426d-94e1-635233c07548 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:01.818384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98506d-080e-426d-94e1-635233c07548 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:01.818660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98506d-080e-426d-94e1-635233c07548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:01.837013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2c98506d-080e-426d-94e1-635233c07548 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:01.838214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c98506d-080e-426d-94e1-635233c07548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:01.896415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1312/2620] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:01.904292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1f5e-f583-4fc8-a54d-d1c8820789d2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:01.904582 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1f5e-f583-4fc8-a54d-d1c8820789d2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:01.904861 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1f5e-f583-4fc8-a54d-d1c8820789d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:01.923510 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d05c1f5e-f583-4fc8-a54d-d1c8820789d2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:01.924736 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d05c1f5e-f583-4fc8-a54d-d1c8820789d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:01.933401 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1309/2621] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:01.937472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98506d-080e-426d-94e1-635233c07548 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:01.947305 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98506d-080e-426d-94e1-635233c07548 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:01.951807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d50263-04d2-4059-b67e-fda042f67a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:01.952574 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d50263-04d2-4059-b67e-fda042f67a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:01.952856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d50263-04d2-4059-b67e-fda042f67a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:01.953131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d50263-04d2-4059-b67e-fda042f67a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:01.953854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d50263-04d2-4059-b67e-fda042f67a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:24:01.954160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d50263-04d2-4059-b67e-fda042f67a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:01.955778 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d50263-04d2-4059-b67e-fda042f67a84 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:01.968018 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1313/2622] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:24:01.972256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1f5e-f583-4fc8-a54d-d1c8820789d2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:01.982056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1f5e-f583-4fc8-a54d-d1c8820789d2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:01.986632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b3f24-1fde-4bc5-baf1-0faf6d80b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:01.987278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b3f24-1fde-4bc5-baf1-0faf6d80b0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:01.987559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b3f24-1fde-4bc5-baf1-0faf6d80b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:01.987892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b3f24-1fde-4bc5-baf1-0faf6d80b0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:01.988670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b3f24-1fde-4bc5-baf1-0faf6d80b0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:01.990567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b3f24-1fde-4bc5-baf1-0faf6d80b0fa admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:02.069024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1310/2623] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:01 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:02.073171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d50263-04d2-4059-b67e-fda042f67a84 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:02.084005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d50263-04d2-4059-b67e-fda042f67a84 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:02.139428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11e8b1-a9eb-4cde-9955-db2eeb20bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:02.140131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11e8b1-a9eb-4cde-9955-db2eeb20bfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:02.140415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11e8b1-a9eb-4cde-9955-db2eeb20bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:02.140687 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11e8b1-a9eb-4cde-9955-db2eeb20bfd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:02.141366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11e8b1-a9eb-4cde-9955-db2eeb20bfd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:02.143267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11e8b1-a9eb-4cde-9955-db2eeb20bfd3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:02.229430 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1314/2624] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:02 2022] POST /identity/v3/users => generated 303 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:02.233597 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b3f24-1fde-4bc5-baf1-0faf6d80b0fa admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:02.244016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b3f24-1fde-4bc5-baf1-0faf6d80b0fa admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:02.248911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a338b-ce41-478d-b467-15fa4055d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:02.249589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a338b-ce41-478d-b467-15fa4055d10a admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:02.249846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a338b-ce41-478d-b467-15fa4055d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:02.250121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a338b-ce41-478d-b467-15fa4055d10a admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:02.250843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a338b-ce41-478d-b467-15fa4055d10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:02.252497 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a338b-ce41-478d-b467-15fa4055d10a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:02.266004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1311/2625] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:02.267023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11e8b1-a9eb-4cde-9955-db2eeb20bfd3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:02.277918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11e8b1-a9eb-4cde-9955-db2eeb20bfd3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:02.283763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40ccdd-263b-464e-a500-550da9600c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:02.284452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40ccdd-263b-464e-a500-550da9600c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:02.284782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40ccdd-263b-464e-a500-550da9600c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:02.285293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40ccdd-263b-464e-a500-550da9600c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:02.286025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40ccdd-263b-464e-a500-550da9600c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:02.287636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40ccdd-263b-464e-a500-550da9600c92 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:02.293114 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:02.300108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1315/2626] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:02.309807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a338b-ce41-478d-b467-15fa4055d10a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:02.320834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a338b-ce41-478d-b467-15fa4055d10a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:02.325488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acda96-a775-49df-ade6-079d428b379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:02.326364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acda96-a775-49df-ade6-079d428b379a admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:02.326647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acda96-a775-49df-ade6-079d428b379a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:02.326926 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acda96-a775-49df-ade6-079d428b379a admin admin] PATH_INFO: `/v3/projects/64d6e3be3612437caccf4b51143a8bcf/users/0122d932fb51433f82192b25b9ca61d9/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:02.344140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acda96-a775-49df-ade6-079d428b379a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d6e3be3612437caccf4b51143a8bcf, user_id=0122d932fb51433f82192b25b9ca61d9, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:02.346827 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acda96-a775-49df-ade6-079d428b379a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:02.416518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1312/2627] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:02 2022] PUT /identity/v3/projects/64d6e3be3612437caccf4b51143a8bcf/users/0122d932fb51433f82192b25b9ca61d9/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:02.427500 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e139-50c1-44a2-b6b1-2816c7696851 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:02.427790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e139-50c1-44a2-b6b1-2816c7696851 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:02.428100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e139-50c1-44a2-b6b1-2816c7696851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:02.454486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3ba3e139-50c1-44a2-b6b1-2816c7696851 None None] MFA Rules not processed for user `0122d932fb51433f82192b25b9ca61d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:02.455752 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3ba3e139-50c1-44a2-b6b1-2816c7696851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:02.524788 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1316/2628] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:02.531990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acda96-a775-49df-ade6-079d428b379a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:02.593910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acda96-a775-49df-ade6-079d428b379a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:02.598675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc64e8-c238-451c-8f23-b0219535760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:02.599358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc64e8-c238-451c-8f23-b0219535760c admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:02.599655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc64e8-c238-451c-8f23-b0219535760c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:02.599961 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc64e8-c238-451c-8f23-b0219535760c admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:02.600646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc64e8-c238-451c-8f23-b0219535760c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:02.602539 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc64e8-c238-451c-8f23-b0219535760c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:02.693902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1313/2629] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:02 2022] POST /identity/v3/projects => generated 405 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:02.697781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e139-50c1-44a2-b6b1-2816c7696851 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:02.708953 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e139-50c1-44a2-b6b1-2816c7696851 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:02.764823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040417b5-d0e5-41d0-9530-19d053b134f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:02.765496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040417b5-d0e5-41d0-9530-19d053b134f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:02.765819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040417b5-d0e5-41d0-9530-19d053b134f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:02.766070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040417b5-d0e5-41d0-9530-19d053b134f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:02.766810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040417b5-d0e5-41d0-9530-19d053b134f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:02.768846 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040417b5-d0e5-41d0-9530-19d053b134f7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:02.840781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1317/2630] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:02 2022] POST /identity/v3/users => generated 309 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:02.845778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc64e8-c238-451c-8f23-b0219535760c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:02.855040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc64e8-c238-451c-8f23-b0219535760c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:02.859652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cd8c7-b1d1-42f3-8c34-1d0ebbe3b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:02.860333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cd8c7-b1d1-42f3-8c34-1d0ebbe3b6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:02.860613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cd8c7-b1d1-42f3-8c34-1d0ebbe3b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:02.860884 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cd8c7-b1d1-42f3-8c34-1d0ebbe3b6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:02.861635 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cd8c7-b1d1-42f3-8c34-1d0ebbe3b6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:02.863780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cd8c7-b1d1-42f3-8c34-1d0ebbe3b6b5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:02.874129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1314/2631] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:02.883080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040417b5-d0e5-41d0-9530-19d053b134f7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:02.893631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040417b5-d0e5-41d0-9530-19d053b134f7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:02.898263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c871-68d0-49a2-89d9-4d79ecb28a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:02.899150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c871-68d0-49a2-89d9-4d79ecb28a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:02.899434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c871-68d0-49a2-89d9-4d79ecb28a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:02.899713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c871-68d0-49a2-89d9-4d79ecb28a56 admin admin] PATH_INFO: `/v3/projects/108ed9dabd48485cb967b9c8fb977a87/users/87f7b1bfd56947b18eff677eef86707d/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:02.914490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55c871-68d0-49a2-89d9-4d79ecb28a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108ed9dabd48485cb967b9c8fb977a87, user_id=87f7b1bfd56947b18eff677eef86707d, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:02.917297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55c871-68d0-49a2-89d9-4d79ecb28a56 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:03.007138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1318/2632] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:02 2022] PUT /identity/v3/projects/108ed9dabd48485cb967b9c8fb977a87/users/87f7b1bfd56947b18eff677eef86707d/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:03.011170 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cd8c7-b1d1-42f3-8c34-1d0ebbe3b6b5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:03.021594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cd8c7-b1d1-42f3-8c34-1d0ebbe3b6b5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:03.063137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:03.078066 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebc5d9-d238-479e-98ce-a471051d1dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:03.078730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebc5d9-d238-479e-98ce-a471051d1dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:03.079017 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebc5d9-d238-479e-98ce-a471051d1dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:03.079295 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebc5d9-d238-479e-98ce-a471051d1dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:03.080065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebc5d9-d238-479e-98ce-a471051d1dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:03.081724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebc5d9-d238-479e-98ce-a471051d1dcf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:03.099232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1315/2633] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:03.099410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c871-68d0-49a2-89d9-4d79ecb28a56 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:03.106934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c871-68d0-49a2-89d9-4d79ecb28a56 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:03.111561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6f25a-9f2d-4633-bdde-52ae1bb5627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:03.112464 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6f25a-9f2d-4633-bdde-52ae1bb5627f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:03.112763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6f25a-9f2d-4633-bdde-52ae1bb5627f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:03.113669 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6f25a-9f2d-4633-bdde-52ae1bb5627f admin admin] PATH_INFO: `/v3/projects/108ed9dabd48485cb967b9c8fb977a87/users/87f7b1bfd56947b18eff677eef86707d/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:03.115787 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6f25a-9f2d-4633-bdde-52ae1bb5627f admin admin] RBAC: Authorizing `identity:create_grant(project_id=108ed9dabd48485cb967b9c8fb977a87, user_id=87f7b1bfd56947b18eff677eef86707d, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:03.118601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6f25a-9f2d-4633-bdde-52ae1bb5627f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:03.129632 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1319/2634] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:03 2022] PUT /identity/v3/projects/108ed9dabd48485cb967b9c8fb977a87/users/87f7b1bfd56947b18eff677eef86707d/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:03.140596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4c5e6-a0d2-45e0-82a3-33aae592bdd9 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:03.140886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4c5e6-a0d2-45e0-82a3-33aae592bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:03.141167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4c5e6-a0d2-45e0-82a3-33aae592bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:03.167367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2ea4c5e6-a0d2-45e0-82a3-33aae592bdd9 None None] MFA Rules not processed for user `87f7b1bfd56947b18eff677eef86707d`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:03.168614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2ea4c5e6-a0d2-45e0-82a3-33aae592bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:03.235645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1316/2635] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:03.247159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6f25a-9f2d-4633-bdde-52ae1bb5627f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:03.248881 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-06b6f25a-9f2d-4633-bdde-52ae1bb5627f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:03.295470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:03.308175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6f25a-9f2d-4633-bdde-52ae1bb5627f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:03.311861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10775914-8af6-4eb7-b2ce-5fe17f6886b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:03.312533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10775914-8af6-4eb7-b2ce-5fe17f6886b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:03.312821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10775914-8af6-4eb7-b2ce-5fe17f6886b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:03.313127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10775914-8af6-4eb7-b2ce-5fe17f6886b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:03.322577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10775914-8af6-4eb7-b2ce-5fe17f6886b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:03.324053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10775914-8af6-4eb7-b2ce-5fe17f6886b9 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:03.334180 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1320/2636] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:03 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:03.468876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4c5e6-a0d2-45e0-82a3-33aae592bdd9 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:03.536336 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4c5e6-a0d2-45e0-82a3-33aae592bdd9 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:03.540805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:03.541667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:03.541949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:03.542220 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] PATH_INFO: `/v3/users/0122d932fb51433f82192b25b9ca61d9` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:03.543392 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0122d932fb51433f82192b25b9ca61d9)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:03.545345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:03.587745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10775914-8af6-4eb7-b2ce-5fe17f6886b9 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:03.589174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-10775914-8af6-4eb7-b2ce-5fe17f6886b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:03.603386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10775914-8af6-4eb7-b2ce-5fe17f6886b9 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:03.607735 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:03.608631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:03.608933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:03.609203 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] PATH_INFO: `/v3/users/3b71e63e78264a2d9f51fb5953563ba0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:03.610370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b71e63e78264a2d9f51fb5953563ba0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:03.612297 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:03.738087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0122d932fb51433f82192b25b9ca61d9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.744964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0122d932fb51433f82192b25b9ca61d9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.791052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b71e63e78264a2d9f51fb5953563ba0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.798487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b71e63e78264a2d9f51fb5953563ba0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.799267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b71e63e78264a2d9f51fb5953563ba0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.811745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b71e63e78264a2d9f51fb5953563ba0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.839988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0122d932fb51433f82192b25b9ca61d9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.840612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0122d932fb51433f82192b25b9ca61d9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.845408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:03.853881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e3a36fbf-15d0-4901-afcd-4ee5525096c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0122d932fb51433f82192b25b9ca61d9'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.859704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1317/2637] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:03 2022] DELETE /identity/v3/users/0122d932fb51433f82192b25b9ca61d9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:03.864869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194702fe-7a44-422a-905d-9b793b045916 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:03.865188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194702fe-7a44-422a-905d-9b793b045916 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:03.865465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194702fe-7a44-422a-905d-9b793b045916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:03.883095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-194702fe-7a44-422a-905d-9b793b045916 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:03.884326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-194702fe-7a44-422a-905d-9b793b045916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:03.908914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20f8153c-1580-45d7-b67b-a6c0897c1019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b71e63e78264a2d9f51fb5953563ba0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:03.915716 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1321/2638] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:03 2022] DELETE /identity/v3/users/3b71e63e78264a2d9f51fb5953563ba0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:03.920190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9862e7-b98c-4349-9fe9-78beb54d796d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:03.920486 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9862e7-b98c-4349-9fe9-78beb54d796d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:03.920771 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9862e7-b98c-4349-9fe9-78beb54d796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:03.938836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4a9862e7-b98c-4349-9fe9-78beb54d796d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:03.940116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a9862e7-b98c-4349-9fe9-78beb54d796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:03.944353 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1318/2639] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:24:03.953772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194702fe-7a44-422a-905d-9b793b045916 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:03.955160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-194702fe-7a44-422a-905d-9b793b045916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:04.002279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1322/2640] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:04.012374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9862e7-b98c-4349-9fe9-78beb54d796d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:04.012969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194702fe-7a44-422a-905d-9b793b045916 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:04.061424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6653a-13f0-4023-8f9a-9d63df15ba9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:04.062099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6653a-13f0-4023-8f9a-9d63df15ba9d service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:04.062385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6653a-13f0-4023-8f9a-9d63df15ba9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:04.062659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6653a-13f0-4023-8f9a-9d63df15ba9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:04.068057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9862e7-b98c-4349-9fe9-78beb54d796d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:04.071677 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d44307-b064-4a9f-96f1-c082022f8689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:04.072375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d44307-b064-4a9f-96f1-c082022f8689 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:04.072656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d44307-b064-4a9f-96f1-c082022f8689 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:04.072934 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d44307-b064-4a9f-96f1-c082022f8689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:04.073360 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6653a-13f0-4023-8f9a-9d63df15ba9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:04.074954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6653a-13f0-4023-8f9a-9d63df15ba9d service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:04.083599 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d44307-b064-4a9f-96f1-c082022f8689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:04.085074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d44307-b064-4a9f-96f1-c082022f8689 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:04.085768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1319/2641] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:24:04.090161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:04.094970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1323/2642] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:24:04.612231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6653a-13f0-4023-8f9a-9d63df15ba9d service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:04.613572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b8d6653a-13f0-4023-8f9a-9d63df15ba9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:04.620461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d44307-b064-4a9f-96f1-c082022f8689 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:04.621878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-21d44307-b064-4a9f-96f1-c082022f8689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:04.630250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6653a-13f0-4023-8f9a-9d63df15ba9d service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:04.636535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d44307-b064-4a9f-96f1-c082022f8689 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:04.636949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:04.637822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:04.638254 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:04.638536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] PATH_INFO: `/v3/projects/50d11d9b8faf4d93b6b61e3028d837bd` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:04.640609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d11d9b8faf4d93b6b61e3028d837bd)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:04.643076 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:04.652108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:04.652949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:04.653242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:04.653524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] PATH_INFO: `/v3/projects/64d6e3be3612437caccf4b51143a8bcf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:04.654860 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d6e3be3612437caccf4b51143a8bcf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:04.656809 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:04.754192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:04.760798 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d11d9b8faf4d93b6b61e3028d837bd', 'request_id': 'req-da9abd66-72f6-45c0-804d-81643cd3defe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.766847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d11d9b8faf4d93b6b61e3028d837bd', 'request_id': 'req-da9abd66-72f6-45c0-804d-81643cd3defe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.772775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d11d9b8faf4d93b6b61e3028d837bd', 'request_id': 'req-da9abd66-72f6-45c0-804d-81643cd3defe'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.784137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d6e3be3612437caccf4b51143a8bcf', 'request_id': 'req-7c1cffcf-f458-4d96-8bbc-a1185eb977de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.839180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] The token cache is being invalidate because project 50d11d9b8faf4d93b6b61e3028d837bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:04.839468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.840250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-da9abd66-72f6-45c0-804d-81643cd3defe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.841797 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1320/2643] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:04 2022] DELETE /identity/v3/projects/50d11d9b8faf4d93b6b61e3028d837bd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:04.846734 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527b672-ac08-40f3-b369-e426916cb65c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:04.847022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527b672-ac08-40f3-b369-e426916cb65c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:04.847895 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527b672-ac08-40f3-b369-e426916cb65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:04.867731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9527b672-ac08-40f3-b369-e426916cb65c None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:04.867911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9527b672-ac08-40f3-b369-e426916cb65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:04.884614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d6e3be3612437caccf4b51143a8bcf', 'request_id': 'req-7c1cffcf-f458-4d96-8bbc-a1185eb977de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.891299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d6e3be3612437caccf4b51143a8bcf', 'request_id': 'req-7c1cffcf-f458-4d96-8bbc-a1185eb977de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.901965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] The token cache is being invalidate because project 64d6e3be3612437caccf4b51143a8bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:04.902267 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.902873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:04.904456 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1324/2644] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:04 2022] DELETE /identity/v3/projects/64d6e3be3612437caccf4b51143a8bcf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:04.908243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:04.909525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:04.934287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1321/2645] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:24:04.942752 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd33c3-91e9-419a-8e72-4a8f24f566aa None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:04.943040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd33c3-91e9-419a-8e72-4a8f24f566aa None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:04.943324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd33c3-91e9-419a-8e72-4a8f24f566aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:04.961845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-66cd33c3-91e9-419a-8e72-4a8f24f566aa None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:04.963053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-66cd33c3-91e9-419a-8e72-4a8f24f566aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:04.970962 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1322/2646] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:24:04.975585 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd33c3-91e9-419a-8e72-4a8f24f566aa None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:04.977905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cffcf-f458-4d96-8bbc-a1185eb977de admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:04.982587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:04.983461 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:04.983742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:04.984048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] PATH_INFO: `/v3/users/87f7b1bfd56947b18eff677eef86707d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:04.984471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd33c3-91e9-419a-8e72-4a8f24f566aa None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:04.985352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f7b1bfd56947b18eff677eef86707d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:04.987276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:04.989327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815fc2-2ff9-4efa-8ad5-93d00d3c90fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:04.989966 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815fc2-2ff9-4efa-8ad5-93d00d3c90fb admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:04.990243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815fc2-2ff9-4efa-8ad5-93d00d3c90fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:04.990536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815fc2-2ff9-4efa-8ad5-93d00d3c90fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:04.991249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815fc2-2ff9-4efa-8ad5-93d00d3c90fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:24:04.991556 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815fc2-2ff9-4efa-8ad5-93d00d3c90fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:04.993180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815fc2-2ff9-4efa-8ad5-93d00d3c90fb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:05.005166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1323/2647] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 12:24:05.009506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815fc2-2ff9-4efa-8ad5-93d00d3c90fb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:05.019531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815fc2-2ff9-4efa-8ad5-93d00d3c90fb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:05.024232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456611-28c2-4b49-b7c5-05fae626c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:05.024866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456611-28c2-4b49-b7c5-05fae626c85a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:05.025144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456611-28c2-4b49-b7c5-05fae626c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:05.025417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456611-28c2-4b49-b7c5-05fae626c85a admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:05.026090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98456611-28c2-4b49-b7c5-05fae626c85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:05.027990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98456611-28c2-4b49-b7c5-05fae626c85a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:05.115763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1324/2648] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:05 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:24:05.119686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456611-28c2-4b49-b7c5-05fae626c85a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:05.180472 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f7b1bfd56947b18eff677eef86707d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:05.181019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456611-28c2-4b49-b7c5-05fae626c85a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:05.185224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582da190-b384-4479-b492-fbf5d73d32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:05.185890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582da190-b384-4479-b492-fbf5d73d32d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:05.186172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582da190-b384-4479-b492-fbf5d73d32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:05.186446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582da190-b384-4479-b492-fbf5d73d32d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:05.187132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582da190-b384-4479-b492-fbf5d73d32d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:05.187723 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f7b1bfd56947b18eff677eef86707d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:05.188428 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f7b1bfd56947b18eff677eef86707d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:05.189075 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582da190-b384-4479-b492-fbf5d73d32d4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:05.203143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f7b1bfd56947b18eff677eef86707d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:05.274493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f7b1bfd56947b18eff677eef86707d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:05.275226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1325/2649] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:05 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:24:05.279193 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582da190-b384-4479-b492-fbf5d73d32d4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:05.280777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-582da190-b384-4479-b492-fbf5d73d32d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:05.281097 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1325/2650] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:04 2022] DELETE /identity/v3/users/87f7b1bfd56947b18eff677eef86707d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:24:05.293968 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582da190-b384-4479-b492-fbf5d73d32d4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:05.306148 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:05.353477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3b530-0da4-4d27-8df1-ca8967e33034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:05.354181 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3b530-0da4-4d27-8df1-ca8967e33034 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:05.354466 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3b530-0da4-4d27-8df1-ca8967e33034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:05.354745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3b530-0da4-4d27-8df1-ca8967e33034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:05.355478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3b530-0da4-4d27-8df1-ca8967e33034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:05.357128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3b530-0da4-4d27-8df1-ca8967e33034 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:05.367652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1326/2651] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:05.371833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:05.377087 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:05.383086 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e34b46-9560-4159-9bd6-8eaae5630123 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:05.387763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b04ae-f152-486f-9e12-489ddfd16be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:05.388450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b04ae-f152-486f-9e12-489ddfd16be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:05.388736 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b04ae-f152-486f-9e12-489ddfd16be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:05.389015 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b04ae-f152-486f-9e12-489ddfd16be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:05.389743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b04ae-f152-486f-9e12-489ddfd16be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:05.391346 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b04ae-f152-486f-9e12-489ddfd16be3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:05.401822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1326/2652] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:05.405950 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3b530-0da4-4d27-8df1-ca8967e33034 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:05.416186 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3b530-0da4-4d27-8df1-ca8967e33034 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:05.421018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe0e6c-1bbf-4448-bb24-fab4403662f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:05.421809 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe0e6c-1bbf-4448-bb24-fab4403662f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:05.422308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe0e6c-1bbf-4448-bb24-fab4403662f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:05.422832 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe0e6c-1bbf-4448-bb24-fab4403662f8 admin admin] PATH_INFO: `/v3/projects/27366b4e0d1746a8a4aa96f7d8ff4061/users/cfb7784198144f248a81e9e2c09b6878/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:05.438178 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe0e6c-1bbf-4448-bb24-fab4403662f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27366b4e0d1746a8a4aa96f7d8ff4061, user_id=cfb7784198144f248a81e9e2c09b6878, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:05.441375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe0e6c-1bbf-4448-bb24-fab4403662f8 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:05.515985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1327/2653] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:05 2022] PUT /identity/v3/projects/27366b4e0d1746a8a4aa96f7d8ff4061/users/cfb7784198144f248a81e9e2c09b6878/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:05.520764 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245e2e4-e5e4-4f2a-975d-239fb381ed55 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:05.521083 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245e2e4-e5e4-4f2a-975d-239fb381ed55 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:05.521384 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245e2e4-e5e4-4f2a-975d-239fb381ed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:05.539387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5245e2e4-e5e4-4f2a-975d-239fb381ed55 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:05.540620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5245e2e4-e5e4-4f2a-975d-239fb381ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:05.601493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1327/2654] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:05.613819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe0e6c-1bbf-4448-bb24-fab4403662f8 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:05.615550 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-bafe0e6c-1bbf-4448-bb24-fab4403662f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:05.672846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe0e6c-1bbf-4448-bb24-fab4403662f8 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:05.677339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce81af-5aef-4fc8-a90b-35460b9d35b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:05.681674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce81af-5aef-4fc8-a90b-35460b9d35b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:05.681674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce81af-5aef-4fc8-a90b-35460b9d35b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:05.681674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce81af-5aef-4fc8-a90b-35460b9d35b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:05.687781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce81af-5aef-4fc8-a90b-35460b9d35b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:05.689250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce81af-5aef-4fc8-a90b-35460b9d35b7 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:05.699639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1328/2655] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:24:05.790833 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245e2e4-e5e4-4f2a-975d-239fb381ed55 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:05.792362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5245e2e4-e5e4-4f2a-975d-239fb381ed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:05.806416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245e2e4-e5e4-4f2a-975d-239fb381ed55 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:05.811915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:05.812920 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:05.813372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:05.813754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] PATH_INFO: `/v3/projects/108ed9dabd48485cb967b9c8fb977a87` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:05.815073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=108ed9dabd48485cb967b9c8fb977a87)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:05.818415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:05.937743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108ed9dabd48485cb967b9c8fb977a87', 'request_id': 'req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:06.011751 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108ed9dabd48485cb967b9c8fb977a87', 'request_id': 'req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:06.018738 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108ed9dabd48485cb967b9c8fb977a87', 'request_id': 'req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:06.031314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] The token cache is being invalidate because project 108ed9dabd48485cb967b9c8fb977a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:06.031648 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:06.032431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81f3c88c-9e88-4b32-a12a-bded5f0fcbfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:06.043223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1328/2656] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:05 2022] DELETE /identity/v3/projects/108ed9dabd48485cb967b9c8fb977a87 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:06.045095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624dbed-ace6-40bd-88b6-fea6a36bc8fb None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.045562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624dbed-ace6-40bd-88b6-fea6a36bc8fb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.045696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624dbed-ace6-40bd-88b6-fea6a36bc8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.065001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e624dbed-ace6-40bd-88b6-fea6a36bc8fb None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:06.066792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e624dbed-ace6-40bd-88b6-fea6a36bc8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:06.131141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1329/2657] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:24:06.138835 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b31f-be58-4fa6-ae3b-a57ec47563af None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.139127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b31f-be58-4fa6-ae3b-a57ec47563af None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.139420 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b31f-be58-4fa6-ae3b-a57ec47563af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.157957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ada8b31f-be58-4fa6-ae3b-a57ec47563af None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:06.159160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ada8b31f-be58-4fa6-ae3b-a57ec47563af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:06.168397 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1329/2658] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:06.172463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624dbed-ace6-40bd-88b6-fea6a36bc8fb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:06.183276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624dbed-ace6-40bd-88b6-fea6a36bc8fb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:06.188350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b6bb-638c-4eac-a05c-8bc9d15a457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:06.188973 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b6bb-638c-4eac-a05c-8bc9d15a457b admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.189592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b6bb-638c-4eac-a05c-8bc9d15a457b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.189592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41b6bb-638c-4eac-a05c-8bc9d15a457b admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.190293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41b6bb-638c-4eac-a05c-8bc9d15a457b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:24:06.190644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41b6bb-638c-4eac-a05c-8bc9d15a457b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:06.192491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41b6bb-638c-4eac-a05c-8bc9d15a457b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:06.204545 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1330/2659] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:24:06.209081 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8b31f-be58-4fa6-ae3b-a57ec47563af None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:06.219159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8b31f-be58-4fa6-ae3b-a57ec47563af None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:06.224989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b62ea-00ff-4568-8b17-d809d18daa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:06.225721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b62ea-00ff-4568-8b17-d809d18daa80 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.226011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b62ea-00ff-4568-8b17-d809d18daa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.226292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b62ea-00ff-4568-8b17-d809d18daa80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.226999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b62ea-00ff-4568-8b17-d809d18daa80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:06.228952 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b62ea-00ff-4568-8b17-d809d18daa80 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:06.315898 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1330/2660] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:06 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:24:06.317086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b6bb-638c-4eac-a05c-8bc9d15a457b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:06.327593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41b6bb-638c-4eac-a05c-8bc9d15a457b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:06.340417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:06.385509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa3a9-fbfa-4bb2-9a20-9b392e701767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:06.386185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa3a9-fbfa-4bb2-9a20-9b392e701767 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.386467 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa3a9-fbfa-4bb2-9a20-9b392e701767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.386740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa3a9-fbfa-4bb2-9a20-9b392e701767 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.387436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaa3a9-fbfa-4bb2-9a20-9b392e701767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:06.389383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaa3a9-fbfa-4bb2-9a20-9b392e701767 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:06.499020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1331/2661] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:06 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:06.503568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b62ea-00ff-4568-8b17-d809d18daa80 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:06.514637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b62ea-00ff-4568-8b17-d809d18daa80 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:06.520192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dffad-e350-4288-96bd-d42e606d491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:06.520923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dffad-e350-4288-96bd-d42e606d491f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.521209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dffad-e350-4288-96bd-d42e606d491f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.521489 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dffad-e350-4288-96bd-d42e606d491f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.522230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dffad-e350-4288-96bd-d42e606d491f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:06.524031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dffad-e350-4288-96bd-d42e606d491f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:06.536569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1331/2662] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:24:06.540653 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa3a9-fbfa-4bb2-9a20-9b392e701767 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:06.551212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa3a9-fbfa-4bb2-9a20-9b392e701767 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:06.556328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff01e8-b5f9-4b91-beec-864f2dc21550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:06.557009 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff01e8-b5f9-4b91-beec-864f2dc21550 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.557294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff01e8-b5f9-4b91-beec-864f2dc21550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.557572 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff01e8-b5f9-4b91-beec-864f2dc21550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.558306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff01e8-b5f9-4b91-beec-864f2dc21550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:06.560002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff01e8-b5f9-4b91-beec-864f2dc21550 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:06.570101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1332/2663] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:06.574285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dffad-e350-4288-96bd-d42e606d491f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:06.584839 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dffad-e350-4288-96bd-d42e606d491f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:06.589540 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41d46f-c8a5-4b16-9558-9f4602bca293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:06.590435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d46f-c8a5-4b16-9558-9f4602bca293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.590769 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d46f-c8a5-4b16-9558-9f4602bca293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.591253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d46f-c8a5-4b16-9558-9f4602bca293 admin admin] PATH_INFO: `/v3/projects/2783ade23dd34fa38f75b3440da2b895/users/7332cd8e95464be0beea57c1c4508d37/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.606789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d46f-c8a5-4b16-9558-9f4602bca293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2783ade23dd34fa38f75b3440da2b895, user_id=7332cd8e95464be0beea57c1c4508d37, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:06.609477 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d46f-c8a5-4b16-9558-9f4602bca293 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:06.674020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1332/2664] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:06 2022] PUT /identity/v3/projects/2783ade23dd34fa38f75b3440da2b895/users/7332cd8e95464be0beea57c1c4508d37/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:24:06.685062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c104e-c0c6-4efc-a1e5-ce77c0c22ad5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.685426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c104e-c0c6-4efc-a1e5-ce77c0c22ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.685777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c104e-c0c6-4efc-a1e5-ce77c0c22ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.714097 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-472c104e-c0c6-4efc-a1e5-ce77c0c22ad5 None None] MFA Rules not processed for user `7332cd8e95464be0beea57c1c4508d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:06.715406 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-472c104e-c0c6-4efc-a1e5-ce77c0c22ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:06.791549 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1333/2665] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:06.796303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41d46f-c8a5-4b16-9558-9f4602bca293 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:06.810730 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:06.858728 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41d46f-c8a5-4b16-9558-9f4602bca293 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:06.864470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ff4e-1408-4b6a-9ba4-80558d5c1644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:06.865059 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ff4e-1408-4b6a-9ba4-80558d5c1644 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:06.865356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ff4e-1408-4b6a-9ba4-80558d5c1644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:06.865650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ff4e-1408-4b6a-9ba4-80558d5c1644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:06.866650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ff4e-1408-4b6a-9ba4-80558d5c1644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:06.868315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ff4e-1408-4b6a-9ba4-80558d5c1644 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:07.078949 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1333/2666] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:06 2022] POST /identity/v3/projects => generated 381 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:07.080143 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c104e-c0c6-4efc-a1e5-ce77c0c22ad5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:07.090825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c104e-c0c6-4efc-a1e5-ce77c0c22ad5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:07.152021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763f3a6-a37e-4259-b44c-8049f03de8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:07.153747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763f3a6-a37e-4259-b44c-8049f03de8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:07.154227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763f3a6-a37e-4259-b44c-8049f03de8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:07.154664 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763f3a6-a37e-4259-b44c-8049f03de8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:07.156516 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763f3a6-a37e-4259-b44c-8049f03de8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:07.159033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763f3a6-a37e-4259-b44c-8049f03de8b3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:07.246672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1334/2667] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:07 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:07.250760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ff4e-1408-4b6a-9ba4-80558d5c1644 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:07.261485 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ff4e-1408-4b6a-9ba4-80558d5c1644 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:07.266098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1585c-0015-4679-adbe-1200e747001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:07.266757 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1585c-0015-4679-adbe-1200e747001d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:07.267042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1585c-0015-4679-adbe-1200e747001d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:07.267371 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1585c-0015-4679-adbe-1200e747001d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:07.268151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1585c-0015-4679-adbe-1200e747001d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:07.270259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1585c-0015-4679-adbe-1200e747001d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:07.280940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1334/2668] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:07.286569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763f3a6-a37e-4259-b44c-8049f03de8b3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:07.297062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763f3a6-a37e-4259-b44c-8049f03de8b3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:07.302147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8b09-01be-469f-857f-089e9420b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:07.303033 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8b09-01be-469f-857f-089e9420b385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:07.303313 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8b09-01be-469f-857f-089e9420b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:07.303586 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce8b09-01be-469f-857f-089e9420b385 admin admin] PATH_INFO: `/v3/projects/9cf22eab1d4449308351de37e9179332/users/fac5e0565bd9404cbe9007841a69da35/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:07.316982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:07.320164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce8b09-01be-469f-857f-089e9420b385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf22eab1d4449308351de37e9179332, user_id=fac5e0565bd9404cbe9007841a69da35, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:07.322955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce8b09-01be-469f-857f-089e9420b385 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:07.434877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1335/2669] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:07 2022] PUT /identity/v3/projects/9cf22eab1d4449308351de37e9179332/users/fac5e0565bd9404cbe9007841a69da35/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:07.438853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1585c-0015-4679-adbe-1200e747001d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:07.449970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1585c-0015-4679-adbe-1200e747001d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:07.513641 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17aa83-ec21-4465-b202-d75f55c2ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:07.514358 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17aa83-ec21-4465-b202-d75f55c2ff7a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:07.514647 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17aa83-ec21-4465-b202-d75f55c2ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:07.514930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17aa83-ec21-4465-b202-d75f55c2ff7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:07.515665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17aa83-ec21-4465-b202-d75f55c2ff7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:07.517299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17aa83-ec21-4465-b202-d75f55c2ff7a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:07.529126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1335/2670] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:24:07.533899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8b09-01be-469f-857f-089e9420b385 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:07.546423 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce8b09-01be-469f-857f-089e9420b385 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:07.552067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14356a2-c5d7-4067-abda-a27fbea0b976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:07.552964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14356a2-c5d7-4067-abda-a27fbea0b976 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:07.553624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14356a2-c5d7-4067-abda-a27fbea0b976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:07.553793 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14356a2-c5d7-4067-abda-a27fbea0b976 admin admin] PATH_INFO: `/v3/projects/9cf22eab1d4449308351de37e9179332/users/fac5e0565bd9404cbe9007841a69da35/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:07.555847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14356a2-c5d7-4067-abda-a27fbea0b976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf22eab1d4449308351de37e9179332, user_id=fac5e0565bd9404cbe9007841a69da35, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:07.558840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14356a2-c5d7-4067-abda-a27fbea0b976 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:07.570012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1336/2671] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:07 2022] PUT /identity/v3/projects/9cf22eab1d4449308351de37e9179332/users/fac5e0565bd9404cbe9007841a69da35/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:24:07.582168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1bf0c-be39-4ebb-a192-871360e65ddd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:07.582551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1bf0c-be39-4ebb-a192-871360e65ddd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:07.582834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1bf0c-be39-4ebb-a192-871360e65ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:07.610427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0cb1bf0c-be39-4ebb-a192-871360e65ddd None None] MFA Rules not processed for user `fac5e0565bd9404cbe9007841a69da35`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:07.611650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0cb1bf0c-be39-4ebb-a192-871360e65ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:07.692396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1336/2672] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:07.701115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14356a2-c5d7-4067-abda-a27fbea0b976 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:07.703639 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c14356a2-c5d7-4067-abda-a27fbea0b976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:07.780280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14356a2-c5d7-4067-abda-a27fbea0b976 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:07.784039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f169194-3822-4869-8d6d-8288fa002967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:07.786985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f169194-3822-4869-8d6d-8288fa002967 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:07.787265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f169194-3822-4869-8d6d-8288fa002967 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:07.787534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f169194-3822-4869-8d6d-8288fa002967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:07.799036 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f169194-3822-4869-8d6d-8288fa002967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:07.801305 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f169194-3822-4869-8d6d-8288fa002967 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:07.811731 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1337/2673] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:08.008490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1bf0c-be39-4ebb-a192-871360e65ddd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:08.022503 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1bf0c-be39-4ebb-a192-871360e65ddd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:08.028606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c04dc-94d2-4478-87db-f79a5e0be754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:08.029368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c04dc-94d2-4478-87db-f79a5e0be754 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:08.029711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c04dc-94d2-4478-87db-f79a5e0be754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:08.030042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c04dc-94d2-4478-87db-f79a5e0be754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:08.035411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:08.096850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c04dc-94d2-4478-87db-f79a5e0be754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:08.099057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c04dc-94d2-4478-87db-f79a5e0be754 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:08.109775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1337/2674] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:11.199157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960388ce-f90b-4b40-9263-7e7aa021ce49 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:11.199940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960388ce-f90b-4b40-9263-7e7aa021ce49 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:11.199940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960388ce-f90b-4b40-9263-7e7aa021ce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:11.231794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-960388ce-f90b-4b40-9263-7e7aa021ce49 None None] MFA Rules not processed for user `cfb7784198144f248a81e9e2c09b6878`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:11.233211 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-960388ce-f90b-4b40-9263-7e7aa021ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:11.308208 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1338/2675] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:11.312717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c04dc-94d2-4478-87db-f79a5e0be754 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:11.314244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d95c04dc-94d2-4478-87db-f79a5e0be754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:11.397092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c04dc-94d2-4478-87db-f79a5e0be754 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:11.402873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd2fb-85aa-4c0d-b71b-da369854bc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:11.403624 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd2fb-85aa-4c0d-b71b-da369854bc93 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:11.404095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd2fb-85aa-4c0d-b71b-da369854bc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:11.404381 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bd2fb-85aa-4c0d-b71b-da369854bc93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:11.405129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bd2fb-85aa-4c0d-b71b-da369854bc93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:11.408495 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bd2fb-85aa-4c0d-b71b-da369854bc93 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:11.516725 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1338/2676] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:11 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:11.520848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960388ce-f90b-4b40-9263-7e7aa021ce49 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:11.534854 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960388ce-f90b-4b40-9263-7e7aa021ce49 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:11.594448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639c238-b6fa-471f-ae1c-85b7225f2b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:11.595133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639c238-b6fa-471f-ae1c-85b7225f2b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:11.595415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639c238-b6fa-471f-ae1c-85b7225f2b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:11.595719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639c238-b6fa-471f-ae1c-85b7225f2b7a admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:11.598105 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639c238-b6fa-471f-ae1c-85b7225f2b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:11.600168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639c238-b6fa-471f-ae1c-85b7225f2b7a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:11.675451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:11.680647 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1339/2677] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:11 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:11.684640 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd2fb-85aa-4c0d-b71b-da369854bc93 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:11.695754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bd2fb-85aa-4c0d-b71b-da369854bc93 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:11.700433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9b7c4-9a16-459f-9fec-9ca0bd46e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:11.701092 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9b7c4-9a16-459f-9fec-9ca0bd46e4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:11.701378 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9b7c4-9a16-459f-9fec-9ca0bd46e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:11.701658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9b7c4-9a16-459f-9fec-9ca0bd46e4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:11.702387 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9b7c4-9a16-459f-9fec-9ca0bd46e4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:11.704003 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9b7c4-9a16-459f-9fec-9ca0bd46e4d4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:11.714781 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1339/2678] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:11.718791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639c238-b6fa-471f-ae1c-85b7225f2b7a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:11.728565 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639c238-b6fa-471f-ae1c-85b7225f2b7a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:11.733121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abebac-daf2-404d-a255-91bbe531a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:11.736019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abebac-daf2-404d-a255-91bbe531a10c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:11.736019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abebac-daf2-404d-a255-91bbe531a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:11.736019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abebac-daf2-404d-a255-91bbe531a10c admin admin] PATH_INFO: `/v3/projects/4d0b108b2f574a53bd3beb1c38e8d865/users/d1cf7577c9004a45a567ce724cf7a3e5/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:11.750935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abebac-daf2-404d-a255-91bbe531a10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0b108b2f574a53bd3beb1c38e8d865, user_id=d1cf7577c9004a45a567ce724cf7a3e5, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:11.754917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abebac-daf2-404d-a255-91bbe531a10c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:11.836434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1340/2679] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:11 2022] PUT /identity/v3/projects/4d0b108b2f574a53bd3beb1c38e8d865/users/d1cf7577c9004a45a567ce724cf7a3e5/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:11.840523 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9b7c4-9a16-459f-9fec-9ca0bd46e4d4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:11.851248 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9b7c4-9a16-459f-9fec-9ca0bd46e4d4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:11.906576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f7a18-519f-4709-a23a-21cba7f2aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:11.907240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f7a18-519f-4709-a23a-21cba7f2aa1e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:11.907524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f7a18-519f-4709-a23a-21cba7f2aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:11.907800 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f7a18-519f-4709-a23a-21cba7f2aa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:11.908559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f7a18-519f-4709-a23a-21cba7f2aa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:11.910153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f7a18-519f-4709-a23a-21cba7f2aa1e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:11.920507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1340/2680] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:11.925851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abebac-daf2-404d-a255-91bbe531a10c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:11.936100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abebac-daf2-404d-a255-91bbe531a10c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:11.941544 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d75f9-f3cc-4d1e-868f-4f998db5e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:11.942439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d75f9-f3cc-4d1e-868f-4f998db5e778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:11.942716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d75f9-f3cc-4d1e-868f-4f998db5e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:11.942985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d75f9-f3cc-4d1e-868f-4f998db5e778 admin admin] PATH_INFO: `/v3/projects/4d0b108b2f574a53bd3beb1c38e8d865/users/d1cf7577c9004a45a567ce724cf7a3e5/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:11.945010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d75f9-f3cc-4d1e-868f-4f998db5e778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0b108b2f574a53bd3beb1c38e8d865, user_id=d1cf7577c9004a45a567ce724cf7a3e5, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:11.953982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d75f9-f3cc-4d1e-868f-4f998db5e778 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:11.958273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1341/2681] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:11 2022] PUT /identity/v3/projects/4d0b108b2f574a53bd3beb1c38e8d865/users/d1cf7577c9004a45a567ce724cf7a3e5/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:17.115805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f7a18-519f-4709-a23a-21cba7f2aa1e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:17.127431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f7a18-519f-4709-a23a-21cba7f2aa1e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:17.144232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:17.197080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:17.198444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:17.198444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:17.198938 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] PATH_INFO: `/v3/users/7332cd8e95464be0beea57c1c4508d37` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:17.200257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7332cd8e95464be0beea57c1c4508d37)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:17.202211 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:17.380470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7332cd8e95464be0beea57c1c4508d37'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:17.390294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7332cd8e95464be0beea57c1c4508d37'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:17.390996 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7332cd8e95464be0beea57c1c4508d37'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:17.405349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7332cd8e95464be0beea57c1c4508d37'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:17.457363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7332cd8e95464be0beea57c1c4508d37'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:17.467866 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1341/2682] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:17 2022] DELETE /identity/v3/users/7332cd8e95464be0beea57c1c4508d37 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:17.470278 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b177-a386-47d7-8060-8f5c02479361 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:17.470938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b177-a386-47d7-8060-8f5c02479361 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:17.470938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407b177-a386-47d7-8060-8f5c02479361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:17.491916 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-8407b177-a386-47d7-8060-8f5c02479361 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:17.493156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-8407b177-a386-47d7-8060-8f5c02479361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:17.591469 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1342/2683] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:17.598145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:17.599626 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:17.688796 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029214a5-f3c0-435a-9499-9f1f400111cf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:17.693184 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7784ec1-acbc-4855-a2d6-2c17332805a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:17.693858 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7784ec1-acbc-4855-a2d6-2c17332805a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:17.694150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7784ec1-acbc-4855-a2d6-2c17332805a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:17.694432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7784ec1-acbc-4855-a2d6-2c17332805a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:17.705685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7784ec1-acbc-4855-a2d6-2c17332805a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:17.708698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7784ec1-acbc-4855-a2d6-2c17332805a4 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:17.721150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1342/2684] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:17.741765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd44da-0c34-478b-9c0d-34aacf08d60a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:17.742079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd44da-0c34-478b-9c0d-34aacf08d60a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:17.742358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd44da-0c34-478b-9c0d-34aacf08d60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:17.773393 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-aabd44da-0c34-478b-9c0d-34aacf08d60a None None] MFA Rules not processed for user `d1cf7577c9004a45a567ce724cf7a3e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:17.774570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aabd44da-0c34-478b-9c0d-34aacf08d60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:17.866209 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1343/2685] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:17.882433 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7784ec1-acbc-4855-a2d6-2c17332805a4 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:17.883972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b7784ec1-acbc-4855-a2d6-2c17332805a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:17.950316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:17.970339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7784ec1-acbc-4855-a2d6-2c17332805a4 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:17.974593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6603a15-eca4-4e58-aa87-450c5030ca51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6784d862961b44f48b385bec777ac439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:17.975293 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603a15-eca4-4e58-aa87-450c5030ca51 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:17.975579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603a15-eca4-4e58-aa87-450c5030ca51 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:17.975856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603a15-eca4-4e58-aa87-450c5030ca51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:17.977802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a6603a15-eca4-4e58-aa87-450c5030ca51 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:18.049033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6603a15-eca4-4e58-aa87-450c5030ca51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:18.051344 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6603a15-eca4-4e58-aa87-450c5030ca51 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:18.063365 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1343/2686] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:18.191494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd44da-0c34-478b-9c0d-34aacf08d60a None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:18.193893 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-aabd44da-0c34-478b-9c0d-34aacf08d60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:18.211007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd44da-0c34-478b-9c0d-34aacf08d60a None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:18.216318 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:18.217484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:18.217484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:18.217724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] PATH_INFO: `/v3/projects/2783ade23dd34fa38f75b3440da2b895` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:18.219128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2783ade23dd34fa38f75b3440da2b895)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:18.221540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:18.287672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7431bb-c17c-473f-aaab-346dbd14b127 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:18.288190 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7431bb-c17c-473f-aaab-346dbd14b127 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:18.288291 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7431bb-c17c-473f-aaab-346dbd14b127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:18.308772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bc7431bb-c17c-473f-aaab-346dbd14b127 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:18.310069 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bc7431bb-c17c-473f-aaab-346dbd14b127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:18.320784 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:18.326177 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2783ade23dd34fa38f75b3440da2b895', 'request_id': 'req-fe3d4846-6b01-4438-b7c9-632735e72756'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.335842 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2783ade23dd34fa38f75b3440da2b895', 'request_id': 'req-fe3d4846-6b01-4438-b7c9-632735e72756'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.342293 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2783ade23dd34fa38f75b3440da2b895', 'request_id': 'req-fe3d4846-6b01-4438-b7c9-632735e72756'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.399990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1344/2687] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:24:18.424056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] The token cache is being invalidate because project 2783ade23dd34fa38f75b3440da2b895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:18.426862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7431bb-c17c-473f-aaab-346dbd14b127 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:18.427018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.427018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.427214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bc7431bb-c17c-473f-aaab-346dbd14b127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:18.428577 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1344/2688] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:18 2022] DELETE /identity/v3/projects/2783ade23dd34fa38f75b3440da2b895 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:18.432232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:18.433661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:18.518987 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d4846-6b01-4438-b7c9-632735e72756 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:18.525197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7431bb-c17c-473f-aaab-346dbd14b127 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:18.528851 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:18.529877 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:18.530181 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:18.530593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] PATH_INFO: `/v3/users/fac5e0565bd9404cbe9007841a69da35` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:18.531537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dec0a-c000-496b-814e-351379303a7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:18.531918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac5e0565bd9404cbe9007841a69da35)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:18.532359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dec0a-c000-496b-814e-351379303a7f service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:18.532707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dec0a-c000-496b-814e-351379303a7f service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:18.533048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dec0a-c000-496b-814e-351379303a7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:18.535944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:18.536589 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a84dec0a-c000-496b-814e-351379303a7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:18.548179 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dec0a-c000-496b-814e-351379303a7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:18.550382 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dec0a-c000-496b-814e-351379303a7f service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:18.560559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1345/2689] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:24:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:24:18.792536 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac5e0565bd9404cbe9007841a69da35'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.807253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac5e0565bd9404cbe9007841a69da35'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.873803 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac5e0565bd9404cbe9007841a69da35'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.874804 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac5e0565bd9404cbe9007841a69da35'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.895314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e5f4463f-213f-493b-9794-4eee58b31173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac5e0565bd9404cbe9007841a69da35'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:18.931001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1345/2690] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:18 2022] DELETE /identity/v3/users/fac5e0565bd9404cbe9007841a69da35 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:24:19.443279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dec0a-c000-496b-814e-351379303a7f service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:19.458584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dec0a-c000-496b-814e-351379303a7f service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:19.502136 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:19.557386 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:19.558452 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:19.558798 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:19.559187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] PATH_INFO: `/v3/projects/9cf22eab1d4449308351de37e9179332` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:19.560476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf22eab1d4449308351de37e9179332)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:19.562462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:19.712980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf22eab1d4449308351de37e9179332', 'request_id': 'req-cb7b0cd5-8933-431a-a118-152a3beef1d8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:19.782499 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf22eab1d4449308351de37e9179332', 'request_id': 'req-cb7b0cd5-8933-431a-a118-152a3beef1d8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:19.792288 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf22eab1d4449308351de37e9179332', 'request_id': 'req-cb7b0cd5-8933-431a-a118-152a3beef1d8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:19.804537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] The token cache is being invalidate because project 9cf22eab1d4449308351de37e9179332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:19.806743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:19.806743 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cb7b0cd5-8933-431a-a118-152a3beef1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:19.808323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1346/2691] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:19 2022] DELETE /identity/v3/projects/9cf22eab1d4449308351de37e9179332 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:19.813198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b08fbb-d0db-4279-ae9d-ac58b81aa7b3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:19.814032 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b08fbb-d0db-4279-ae9d-ac58b81aa7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:19.814487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b08fbb-d0db-4279-ae9d-ac58b81aa7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:19.833922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-92b08fbb-d0db-4279-ae9d-ac58b81aa7b3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:19.835149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-92b08fbb-d0db-4279-ae9d-ac58b81aa7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:19.890196 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:19.907970 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1346/2692] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:19.916421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c04e8-9215-40a6-ba15-5af4b9216de4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:19.916903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c04e8-9215-40a6-ba15-5af4b9216de4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:19.917374 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c04e8-9215-40a6-ba15-5af4b9216de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:19.938954 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-284c04e8-9215-40a6-ba15-5af4b9216de4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:19.940300 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-284c04e8-9215-40a6-ba15-5af4b9216de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:19.955459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1347/2693] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:19.957477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b08fbb-d0db-4279-ae9d-ac58b81aa7b3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:19.969772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b08fbb-d0db-4279-ae9d-ac58b81aa7b3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:19.975610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd8712-d89d-464a-9982-2ff44ef77e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:19.976654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd8712-d89d-464a-9982-2ff44ef77e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:19.976948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd8712-d89d-464a-9982-2ff44ef77e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:19.977225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd8712-d89d-464a-9982-2ff44ef77e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:19.977969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd8712-d89d-464a-9982-2ff44ef77e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:24:19.978284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd8712-d89d-464a-9982-2ff44ef77e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:19.979928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd8712-d89d-464a-9982-2ff44ef77e9e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:19.995587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1347/2694] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:24:19.999780 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c04e8-9215-40a6-ba15-5af4b9216de4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:20.012487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c04e8-9215-40a6-ba15-5af4b9216de4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:20.017390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714509-aaeb-4d28-ac56-866e7c5c8670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:20.018141 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714509-aaeb-4d28-ac56-866e7c5c8670 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:20.019217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714509-aaeb-4d28-ac56-866e7c5c8670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:20.019602 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714509-aaeb-4d28-ac56-866e7c5c8670 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:20.020491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714509-aaeb-4d28-ac56-866e7c5c8670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:20.022508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa714509-aaeb-4d28-ac56-866e7c5c8670 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:20.127931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1348/2695] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:19 2022] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:20.130160 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd8712-d89d-464a-9982-2ff44ef77e9e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:20.142159 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd8712-d89d-464a-9982-2ff44ef77e9e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:20.226858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ee8e6-856d-4d35-8991-41a0ecbb14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:20.228028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ee8e6-856d-4d35-8991-41a0ecbb14a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:20.228028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ee8e6-856d-4d35-8991-41a0ecbb14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:20.228028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ee8e6-856d-4d35-8991-41a0ecbb14a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:20.229542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ee8e6-856d-4d35-8991-41a0ecbb14a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:20.231508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ee8e6-856d-4d35-8991-41a0ecbb14a4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:20.325865 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1348/2696] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:20 2022] POST /identity/v3/users => generated 281 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:24:20.327028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714509-aaeb-4d28-ac56-866e7c5c8670 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:20.344230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714509-aaeb-4d28-ac56-866e7c5c8670 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:20.353151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ba6f4-5645-4cd1-908f-5234bc25a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:20.356922 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ba6f4-5645-4cd1-908f-5234bc25a67f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:20.360855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ba6f4-5645-4cd1-908f-5234bc25a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:20.360855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ba6f4-5645-4cd1-908f-5234bc25a67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:20.362727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ba6f4-5645-4cd1-908f-5234bc25a67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:20.366128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ba6f4-5645-4cd1-908f-5234bc25a67f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:20.387132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1349/2697] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:20.388489 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ee8e6-856d-4d35-8991-41a0ecbb14a4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:20.406270 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ee8e6-856d-4d35-8991-41a0ecbb14a4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:20.414204 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e75ca-b89c-4013-a749-f2cd96106266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:20.415724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e75ca-b89c-4013-a749-f2cd96106266 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:20.422538 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e75ca-b89c-4013-a749-f2cd96106266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:20.423217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e75ca-b89c-4013-a749-f2cd96106266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:20.424223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e75ca-b89c-4013-a749-f2cd96106266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:20.426203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e75ca-b89c-4013-a749-f2cd96106266 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:20.460891 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1349/2698] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:20.462195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ba6f4-5645-4cd1-908f-5234bc25a67f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:20.475916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ba6f4-5645-4cd1-908f-5234bc25a67f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:20.483754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcb158-61bd-45b8-b97f-33840fdac441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:20.484765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcb158-61bd-45b8-b97f-33840fdac441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:20.486034 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcb158-61bd-45b8-b97f-33840fdac441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:20.486491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcb158-61bd-45b8-b97f-33840fdac441 admin admin] PATH_INFO: `/v3/projects/43266dc14bf14b72bfa86c28832a7f1f/users/b3ae4096d48a44f297c75ac5547a6cc2/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:20.513131 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcb158-61bd-45b8-b97f-33840fdac441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43266dc14bf14b72bfa86c28832a7f1f, user_id=b3ae4096d48a44f297c75ac5547a6cc2, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:20.516266 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcb158-61bd-45b8-b97f-33840fdac441 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:20.594867 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1350/2699] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:20 2022] PUT /identity/v3/projects/43266dc14bf14b72bfa86c28832a7f1f/users/b3ae4096d48a44f297c75ac5547a6cc2/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:20.596223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f6af1-9af7-4a16-b2af-2a14efaece77 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:20.596691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f6af1-9af7-4a16-b2af-2a14efaece77 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:20.596858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f6af1-9af7-4a16-b2af-2a14efaece77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:20.630344 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-122f6af1-9af7-4a16-b2af-2a14efaece77 None None] MFA Rules not processed for user `b3ae4096d48a44f297c75ac5547a6cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:20.631574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-122f6af1-9af7-4a16-b2af-2a14efaece77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:20.756823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1350/2700] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:24:20.757826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcb158-61bd-45b8-b97f-33840fdac441 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:20.836580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:20.853136 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcb158-61bd-45b8-b97f-33840fdac441 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:20.854435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd69f04-4ce6-4342-a074-4c21839616ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:20.855110 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69f04-4ce6-4342-a074-4c21839616ce admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:20.855395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69f04-4ce6-4342-a074-4c21839616ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:20.855670 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69f04-4ce6-4342-a074-4c21839616ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:20.856407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd69f04-4ce6-4342-a074-4c21839616ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:20.858319 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd69f04-4ce6-4342-a074-4c21839616ce admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:20.970583 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1351/2701] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:20 2022] POST /identity/v3/projects => generated 363 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:24:20.971304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f6af1-9af7-4a16-b2af-2a14efaece77 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:20.985552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f6af1-9af7-4a16-b2af-2a14efaece77 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:21.048165 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:21.068384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a287-4331-454d-aa24-d5c87379026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:21.069223 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a287-4331-454d-aa24-d5c87379026d admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:21.069593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a287-4331-454d-aa24-d5c87379026d admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:21.069937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a287-4331-454d-aa24-d5c87379026d admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:21.070700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a287-4331-454d-aa24-d5c87379026d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:21.072875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a287-4331-454d-aa24-d5c87379026d admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:21.144957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1351/2702] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:20 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:21.149064 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd69f04-4ce6-4342-a074-4c21839616ce admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:21.164504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd69f04-4ce6-4342-a074-4c21839616ce admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:21.170551 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2ad93-9dfc-4d65-add1-6d271de8500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:21.171390 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2ad93-9dfc-4d65-add1-6d271de8500b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:21.171789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2ad93-9dfc-4d65-add1-6d271de8500b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:21.172194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2ad93-9dfc-4d65-add1-6d271de8500b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:21.173325 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2ad93-9dfc-4d65-add1-6d271de8500b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:21.175673 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2ad93-9dfc-4d65-add1-6d271de8500b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:21.196003 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1352/2703] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:21.199985 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a287-4331-454d-aa24-d5c87379026d admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:21.215426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a287-4331-454d-aa24-d5c87379026d admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:21.220700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff130f8-92aa-4381-8faf-6f98edd68059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:21.223937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff130f8-92aa-4381-8faf-6f98edd68059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:21.223937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff130f8-92aa-4381-8faf-6f98edd68059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:21.223937 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff130f8-92aa-4381-8faf-6f98edd68059 admin admin] PATH_INFO: `/v3/projects/2152173637ed4abba1c540368aeb0e9f/users/5cfd27a2e7114e3bbcf50057162a3b70/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:21.242445 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff130f8-92aa-4381-8faf-6f98edd68059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2152173637ed4abba1c540368aeb0e9f, user_id=5cfd27a2e7114e3bbcf50057162a3b70, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:21.245654 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff130f8-92aa-4381-8faf-6f98edd68059 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:21.313310 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1352/2704] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:21 2022] PUT /identity/v3/projects/2152173637ed4abba1c540368aeb0e9f/users/5cfd27a2e7114e3bbcf50057162a3b70/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:21.318170 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2ad93-9dfc-4d65-add1-6d271de8500b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:21.334618 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2ad93-9dfc-4d65-add1-6d271de8500b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:21.417636 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dfd27-5695-4960-bbb7-a1adde37429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:21.418907 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dfd27-5695-4960-bbb7-a1adde37429c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:21.419569 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dfd27-5695-4960-bbb7-a1adde37429c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:21.420125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dfd27-5695-4960-bbb7-a1adde37429c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:21.421444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dfd27-5695-4960-bbb7-a1adde37429c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:21.423903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dfd27-5695-4960-bbb7-a1adde37429c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:21.437668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1353/2705] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:21.443215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff130f8-92aa-4381-8faf-6f98edd68059 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:21.457102 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff130f8-92aa-4381-8faf-6f98edd68059 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:21.462400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da668f-d1b0-4acd-a213-c77b2eca1306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:21.463495 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da668f-d1b0-4acd-a213-c77b2eca1306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:21.463931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da668f-d1b0-4acd-a213-c77b2eca1306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:21.464334 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da668f-d1b0-4acd-a213-c77b2eca1306 admin admin] PATH_INFO: `/v3/projects/2152173637ed4abba1c540368aeb0e9f/users/5cfd27a2e7114e3bbcf50057162a3b70/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:21.467092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da668f-d1b0-4acd-a213-c77b2eca1306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2152173637ed4abba1c540368aeb0e9f, user_id=5cfd27a2e7114e3bbcf50057162a3b70, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:21.470357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da668f-d1b0-4acd-a213-c77b2eca1306 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:21.488997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1353/2706] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:21 2022] PUT /identity/v3/projects/2152173637ed4abba1c540368aeb0e9f/users/5cfd27a2e7114e3bbcf50057162a3b70/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:21.499366 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945df87b-5c52-46f5-a4f3-05040cac8346 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:21.500043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945df87b-5c52-46f5-a4f3-05040cac8346 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:21.500043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945df87b-5c52-46f5-a4f3-05040cac8346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:21.539201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-945df87b-5c52-46f5-a4f3-05040cac8346 None None] MFA Rules not processed for user `5cfd27a2e7114e3bbcf50057162a3b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:21.540676 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-945df87b-5c52-46f5-a4f3-05040cac8346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:21.630710 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1354/2707] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:21.644363 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da668f-d1b0-4acd-a213-c77b2eca1306 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:21.646226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d8da668f-d1b0-4acd-a213-c77b2eca1306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:21.711714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da668f-d1b0-4acd-a213-c77b2eca1306 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:21.715385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aeac6a-8732-436f-906c-6b1f9f9757d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:21.716073 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeac6a-8732-436f-906c-6b1f9f9757d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:21.716356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeac6a-8732-436f-906c-6b1f9f9757d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:21.716632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aeac6a-8732-436f-906c-6b1f9f9757d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:21.727757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aeac6a-8732-436f-906c-6b1f9f9757d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:21.729226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aeac6a-8732-436f-906c-6b1f9f9757d2 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:21.739216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1354/2708] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:24:22.060892 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945df87b-5c52-46f5-a4f3-05040cac8346 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:22.078844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945df87b-5c52-46f5-a4f3-05040cac8346 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:22.086786 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7430bc-d670-4199-8418-5e63b16defb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:22.089741 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7430bc-d670-4199-8418-5e63b16defb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:22.090033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7430bc-d670-4199-8418-5e63b16defb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:22.090314 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7430bc-d670-4199-8418-5e63b16defb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:22.182025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:22.206843 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7430bc-d670-4199-8418-5e63b16defb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:22.215380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7430bc-d670-4199-8418-5e63b16defb8 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:22.227188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1355/2709] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:29.882995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fdad-1929-4bea-b5e8-72c89482cf97 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:29.883581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fdad-1929-4bea-b5e8-72c89482cf97 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:29.883581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fdad-1929-4bea-b5e8-72c89482cf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:29.901463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-9867fdad-1929-4bea-b5e8-72c89482cf97 None None] MFA Rules not processed for user `cfb7784198144f248a81e9e2c09b6878`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:29.902669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9867fdad-1929-4bea-b5e8-72c89482cf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:29.962352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1355/2710] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:29.998493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7430bc-d670-4199-8418-5e63b16defb8 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:29.999925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe7430bc-d670-4199-8418-5e63b16defb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:30.062679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7430bc-d670-4199-8418-5e63b16defb8 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:30.067134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0d4d8-23bd-4803-989d-eab37849daae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6784d862961b44f48b385bec777ac439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:30.067789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0d4d8-23bd-4803-989d-eab37849daae service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:30.068096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0d4d8-23bd-4803-989d-eab37849daae service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:30.068619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0d4d8-23bd-4803-989d-eab37849daae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:30.070163 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88d0d4d8-23bd-4803-989d-eab37849daae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:30.146191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0d4d8-23bd-4803-989d-eab37849daae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:30.147693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0d4d8-23bd-4803-989d-eab37849daae service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:30.158873 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1356/2711] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:30.794758 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fdad-1929-4bea-b5e8-72c89482cf97 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:30.796356 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-9867fdad-1929-4bea-b5e8-72c89482cf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:30.861120 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:30.864532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fdad-1929-4bea-b5e8-72c89482cf97 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:30.868438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab9fdf-2005-4bd3-82fd-11df086f3510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:30.869091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab9fdf-2005-4bd3-82fd-11df086f3510 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:30.869375 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab9fdf-2005-4bd3-82fd-11df086f3510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:30.869661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab9fdf-2005-4bd3-82fd-11df086f3510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:30.871424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-31ab9fdf-2005-4bd3-82fd-11df086f3510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:30.885426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab9fdf-2005-4bd3-82fd-11df086f3510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:30.889484 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab9fdf-2005-4bd3-82fd-11df086f3510 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:30.898609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1356/2712] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:32.042120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0d4d8-23bd-4803-989d-eab37849daae service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:32.105564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0d4d8-23bd-4803-989d-eab37849daae service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:32.110253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:32.111120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:32.111399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:32.111671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] PATH_INFO: `/v3/users/b3ae4096d48a44f297c75ac5547a6cc2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:32.113671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ae4096d48a44f297c75ac5547a6cc2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:32.115739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:32.366167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:32.379750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ae4096d48a44f297c75ac5547a6cc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:32.387219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ae4096d48a44f297c75ac5547a6cc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:32.387887 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ae4096d48a44f297c75ac5547a6cc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:32.399713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ae4096d48a44f297c75ac5547a6cc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:32.473832 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ae4096d48a44f297c75ac5547a6cc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:32.480148 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1357/2713] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:32 2022] DELETE /identity/v3/users/b3ae4096d48a44f297c75ac5547a6cc2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:32.495554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adb54a-7ef3-4c83-9229-5f2c3e447117 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:32.495554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adb54a-7ef3-4c83-9229-5f2c3e447117 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:32.495554 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adb54a-7ef3-4c83-9229-5f2c3e447117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:32.504781 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-b2adb54a-7ef3-4c83-9229-5f2c3e447117 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:32.505995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b2adb54a-7ef3-4c83-9229-5f2c3e447117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:32.567859 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1357/2714] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:32.577595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:32.578997 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:32.640055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea4718-52e6-4596-ad1a-0c2981f1f2dc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:32.644398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2ad6-6dad-433d-b48f-8e679d66b4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:32.645906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2ad6-6dad-433d-b48f-8e679d66b4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:32.645906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2ad6-6dad-433d-b48f-8e679d66b4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:32.645906 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2ad6-6dad-433d-b48f-8e679d66b4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:32.654622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d2ad6-6dad-433d-b48f-8e679d66b4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:32.656136 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d2ad6-6dad-433d-b48f-8e679d66b4d2 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:32.666975 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1358/2715] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:33.018083 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adb54a-7ef3-4c83-9229-5f2c3e447117 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:33.019659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b2adb54a-7ef3-4c83-9229-5f2c3e447117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:33.031724 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adb54a-7ef3-4c83-9229-5f2c3e447117 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:33.038820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:33.039745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:33.040487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:33.040487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] PATH_INFO: `/v3/projects/43266dc14bf14b72bfa86c28832a7f1f` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:33.041740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] RBAC: Authorizing `identity:delete_project(project_id=43266dc14bf14b72bfa86c28832a7f1f)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:33.043955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:33.154056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43266dc14bf14b72bfa86c28832a7f1f', 'request_id': 'req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.160340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43266dc14bf14b72bfa86c28832a7f1f', 'request_id': 'req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.165822 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43266dc14bf14b72bfa86c28832a7f1f', 'request_id': 'req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.250491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] The token cache is being invalidate because project 43266dc14bf14b72bfa86c28832a7f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:33.250778 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.251396 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d1dcfda2-1ccb-4be7-82f6-e759eaa7658e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.253645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1358/2716] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:33 2022] DELETE /identity/v3/projects/43266dc14bf14b72bfa86c28832a7f1f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:33.258271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2ad6-6dad-433d-b48f-8e679d66b4d2 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:33.267210 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2ad6-6dad-433d-b48f-8e679d66b4d2 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:33.324901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:33.325785 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:33.326067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:33.326356 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] PATH_INFO: `/v3/users/5cfd27a2e7114e3bbcf50057162a3b70` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:33.327556 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfd27a2e7114e3bbcf50057162a3b70)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:33.329519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:33.550352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfd27a2e7114e3bbcf50057162a3b70'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.551403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:33.554369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfd27a2e7114e3bbcf50057162a3b70'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.555061 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfd27a2e7114e3bbcf50057162a3b70'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.567292 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfd27a2e7114e3bbcf50057162a3b70'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.668196 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfd27a2e7114e3bbcf50057162a3b70'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:33.677121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1359/2717] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:33 2022] DELETE /identity/v3/users/5cfd27a2e7114e3bbcf50057162a3b70 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:24:34.045203 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b7e4d-97e6-47b9-80f5-6ce4101d2785 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:34.045691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b7e4d-97e6-47b9-80f5-6ce4101d2785 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:34.050434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b7e4d-97e6-47b9-80f5-6ce4101d2785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:34.064794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1f1b7e4d-97e6-47b9-80f5-6ce4101d2785 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:34.066614 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1f1b7e4d-97e6-47b9-80f5-6ce4101d2785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:34.124986 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1359/2718] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:34.127445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:34.130528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:34.152881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b7e4d-97e6-47b9-80f5-6ce4101d2785 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:34.154525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1f1b7e4d-97e6-47b9-80f5-6ce4101d2785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:34.180350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:34.247474 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaeade-89f6-4c47-b60a-485569d39beb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:34.251679 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b7e4d-97e6-47b9-80f5-6ce4101d2785 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:34.255734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:34.256675 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:34.257048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:34.257328 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] PATH_INFO: `/v3/projects/2152173637ed4abba1c540368aeb0e9f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:34.259283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2152173637ed4abba1c540368aeb0e9f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:34.260491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf01b4-d701-452a-bd80-9491f158c9fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:34.261202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf01b4-d701-452a-bd80-9491f158c9fc service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:34.261488 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf01b4-d701-452a-bd80-9491f158c9fc service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:34.261765 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf01b4-d701-452a-bd80-9491f158c9fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:34.262893 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:34.272022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf01b4-d701-452a-bd80-9491f158c9fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:34.276218 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf01b4-d701-452a-bd80-9491f158c9fc service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:34.284010 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1360/2719] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:24:34.404205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2152173637ed4abba1c540368aeb0e9f', 'request_id': 'req-db15d60b-7679-4b35-b4c3-ed1019d97e8e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:34.526450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2152173637ed4abba1c540368aeb0e9f', 'request_id': 'req-db15d60b-7679-4b35-b4c3-ed1019d97e8e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:34.536327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2152173637ed4abba1c540368aeb0e9f', 'request_id': 'req-db15d60b-7679-4b35-b4c3-ed1019d97e8e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:34.554132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] The token cache is being invalidate because project 2152173637ed4abba1c540368aeb0e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:34.554754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:34.555815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-db15d60b-7679-4b35-b4c3-ed1019d97e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:34.558148 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1360/2720] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:34 2022] DELETE /identity/v3/projects/2152173637ed4abba1c540368aeb0e9f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:34.563965 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce0642-f2f9-495e-9a39-b68bbe4e0316 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:34.564502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce0642-f2f9-495e-9a39-b68bbe4e0316 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:34.564878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce0642-f2f9-495e-9a39-b68bbe4e0316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:34.600940 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-51ce0642-f2f9-495e-9a39-b68bbe4e0316 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:34.602198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-51ce0642-f2f9-495e-9a39-b68bbe4e0316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:34.740328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1361/2721] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:34.747926 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2c5fa-74c8-4ba6-844e-ddca15236739 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:34.748294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2c5fa-74c8-4ba6-844e-ddca15236739 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:34.748651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2c5fa-74c8-4ba6-844e-ddca15236739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:34.779842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ecd2c5fa-74c8-4ba6-844e-ddca15236739 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:34.781466 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ecd2c5fa-74c8-4ba6-844e-ddca15236739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:34.791070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1361/2722] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:34.795629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce0642-f2f9-495e-9a39-b68bbe4e0316 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:34.810751 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce0642-f2f9-495e-9a39-b68bbe4e0316 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:34.816291 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744386-c8a2-4dcc-b2b9-60e77a153659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:34.817172 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744386-c8a2-4dcc-b2b9-60e77a153659 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:34.818509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744386-c8a2-4dcc-b2b9-60e77a153659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:34.818509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744386-c8a2-4dcc-b2b9-60e77a153659 admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:34.819299 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744386-c8a2-4dcc-b2b9-60e77a153659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:24:34.819837 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744386-c8a2-4dcc-b2b9-60e77a153659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:34.822789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744386-c8a2-4dcc-b2b9-60e77a153659 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:34.839703 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1362/2723] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:24:34.844999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2c5fa-74c8-4ba6-844e-ddca15236739 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:34.857161 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2c5fa-74c8-4ba6-844e-ddca15236739 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:34.865651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2fb8-cd00-44c5-bc56-ad007d9cd4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:34.867886 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2fb8-cd00-44c5-bc56-ad007d9cd4fe admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:34.868421 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2fb8-cd00-44c5-bc56-ad007d9cd4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:34.868855 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2fb8-cd00-44c5-bc56-ad007d9cd4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:34.869885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff2fb8-cd00-44c5-bc56-ad007d9cd4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:34.873053 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff2fb8-cd00-44c5-bc56-ad007d9cd4fe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:34.976963 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1362/2724] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:34 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:34.981119 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744386-c8a2-4dcc-b2b9-60e77a153659 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:34.993819 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744386-c8a2-4dcc-b2b9-60e77a153659 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:35.074002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a206d-943c-4ce3-9e99-de686d29105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:35.074707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a206d-943c-4ce3-9e99-de686d29105a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:35.074999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a206d-943c-4ce3-9e99-de686d29105a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:35.075283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a206d-943c-4ce3-9e99-de686d29105a admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:35.078093 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a206d-943c-4ce3-9e99-de686d29105a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:35.080094 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a206d-943c-4ce3-9e99-de686d29105a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:35.199853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1363/2725] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:34 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:35.203770 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2fb8-cd00-44c5-bc56-ad007d9cd4fe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:35.218667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2fb8-cd00-44c5-bc56-ad007d9cd4fe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:35.229276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a960a-fbe5-4fa1-ab56-d0f126e7126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:35.232244 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a960a-fbe5-4fa1-ab56-d0f126e7126f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:35.236219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a960a-fbe5-4fa1-ab56-d0f126e7126f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:35.236219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a960a-fbe5-4fa1-ab56-d0f126e7126f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:35.236219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a960a-fbe5-4fa1-ab56-d0f126e7126f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:35.241280 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a960a-fbe5-4fa1-ab56-d0f126e7126f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:35.265645 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a206d-943c-4ce3-9e99-de686d29105a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:35.265779 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1363/2726] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:24:35.287086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a206d-943c-4ce3-9e99-de686d29105a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:35.301952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025af24-b35b-4ce8-b947-109df2e5d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:35.302886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025af24-b35b-4ce8-b947-109df2e5d0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:35.303261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025af24-b35b-4ce8-b947-109df2e5d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:35.303602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025af24-b35b-4ce8-b947-109df2e5d0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:35.304676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025af24-b35b-4ce8-b947-109df2e5d0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:35.306368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025af24-b35b-4ce8-b947-109df2e5d0e1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:35.328414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1364/2727] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:35.329674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a960a-fbe5-4fa1-ab56-d0f126e7126f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:35.352191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a960a-fbe5-4fa1-ab56-d0f126e7126f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:35.358067 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e08ffa-e7cb-4962-869a-72dbdc4e0d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:35.372925 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e08ffa-e7cb-4962-869a-72dbdc4e0d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:35.373432 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e08ffa-e7cb-4962-869a-72dbdc4e0d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:35.373871 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e08ffa-e7cb-4962-869a-72dbdc4e0d10 admin admin] PATH_INFO: `/v3/projects/af7a0c113c80480389516a421c6e98be/users/7af8b63ea4904400b959e809c0bdd5e7/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:35.420464 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e08ffa-e7cb-4962-869a-72dbdc4e0d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7a0c113c80480389516a421c6e98be, user_id=7af8b63ea4904400b959e809c0bdd5e7, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:35.427294 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e08ffa-e7cb-4962-869a-72dbdc4e0d10 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:35.438195 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:35.538383 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1364/2728] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:35 2022] PUT /identity/v3/projects/af7a0c113c80480389516a421c6e98be/users/7af8b63ea4904400b959e809c0bdd5e7/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:35.550468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc033d4-f0dc-4f71-a009-992605a7f56c None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:35.550983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc033d4-f0dc-4f71-a009-992605a7f56c None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:35.551358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc033d4-f0dc-4f71-a009-992605a7f56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:35.585109 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:35.591908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1bc033d4-f0dc-4f71-a009-992605a7f56c None None] MFA Rules not processed for user `7af8b63ea4904400b959e809c0bdd5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:35.593344 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1bc033d4-f0dc-4f71-a009-992605a7f56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:35.722792 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1365/2729] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:35.723577 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e08ffa-e7cb-4962-869a-72dbdc4e0d10 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:35.831128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e08ffa-e7cb-4962-869a-72dbdc4e0d10 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:35.837351 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827fc11-4b34-4cce-ad8b-d820efcba683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:35.838880 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827fc11-4b34-4cce-ad8b-d820efcba683 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:35.839411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827fc11-4b34-4cce-ad8b-d820efcba683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:35.839891 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827fc11-4b34-4cce-ad8b-d820efcba683 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:35.840601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827fc11-4b34-4cce-ad8b-d820efcba683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:35.842539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827fc11-4b34-4cce-ad8b-d820efcba683 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:35.943862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1365/2730] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:35 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:35.953192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc033d4-f0dc-4f71-a009-992605a7f56c None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:35.965132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc033d4-f0dc-4f71-a009-992605a7f56c None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:36.033309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7e3fa-777a-4a49-8e43-8b6faf413eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:36.035224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7e3fa-777a-4a49-8e43-8b6faf413eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:36.035698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7e3fa-777a-4a49-8e43-8b6faf413eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:36.036107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7e3fa-777a-4a49-8e43-8b6faf413eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:36.036905 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7e3fa-777a-4a49-8e43-8b6faf413eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:36.039072 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7e3fa-777a-4a49-8e43-8b6faf413eb5 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:36.098112 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1366/2731] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:35 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:36.102080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827fc11-4b34-4cce-ad8b-d820efcba683 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:36.113122 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827fc11-4b34-4cce-ad8b-d820efcba683 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:36.117804 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52335fbd-a64e-4ef8-a48f-e35fb6136d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:36.118460 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52335fbd-a64e-4ef8-a48f-e35fb6136d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:36.118747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52335fbd-a64e-4ef8-a48f-e35fb6136d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:36.119026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52335fbd-a64e-4ef8-a48f-e35fb6136d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:36.119748 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52335fbd-a64e-4ef8-a48f-e35fb6136d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:36.121394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52335fbd-a64e-4ef8-a48f-e35fb6136d31 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:36.133960 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1366/2732] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:36.137971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7e3fa-777a-4a49-8e43-8b6faf413eb5 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:36.149089 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7e3fa-777a-4a49-8e43-8b6faf413eb5 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:36.153926 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adfd37-5659-41a1-96e3-f5740110f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:36.154823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adfd37-5659-41a1-96e3-f5740110f7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:36.155234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adfd37-5659-41a1-96e3-f5740110f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:36.155509 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adfd37-5659-41a1-96e3-f5740110f7eb admin admin] PATH_INFO: `/v3/projects/f473824894f74b6b91ca630ef55c7d50/users/367aa5131ea94025922150d8a1926bfc/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:36.173081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adfd37-5659-41a1-96e3-f5740110f7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f473824894f74b6b91ca630ef55c7d50, user_id=367aa5131ea94025922150d8a1926bfc, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:36.176508 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adfd37-5659-41a1-96e3-f5740110f7eb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:36.217514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1367/2733] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:36 2022] PUT /identity/v3/projects/f473824894f74b6b91ca630ef55c7d50/users/367aa5131ea94025922150d8a1926bfc/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:36.222071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52335fbd-a64e-4ef8-a48f-e35fb6136d31 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:36.232487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52335fbd-a64e-4ef8-a48f-e35fb6136d31 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:36.292845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13778d-98aa-4682-b917-9c1a090db86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:36.293549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13778d-98aa-4682-b917-9c1a090db86e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:36.293795 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13778d-98aa-4682-b917-9c1a090db86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:36.294072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13778d-98aa-4682-b917-9c1a090db86e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:36.294807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13778d-98aa-4682-b917-9c1a090db86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:36.296454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13778d-98aa-4682-b917-9c1a090db86e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:36.308454 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1367/2734] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:36.312621 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adfd37-5659-41a1-96e3-f5740110f7eb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:36.325723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adfd37-5659-41a1-96e3-f5740110f7eb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:36.331096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0a03d-36e6-4a8d-93f6-62c4a4b141fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:36.332067 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0a03d-36e6-4a8d-93f6-62c4a4b141fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:36.332475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0a03d-36e6-4a8d-93f6-62c4a4b141fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:36.332771 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0a03d-36e6-4a8d-93f6-62c4a4b141fb admin admin] PATH_INFO: `/v3/projects/f473824894f74b6b91ca630ef55c7d50/users/367aa5131ea94025922150d8a1926bfc/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:36.335031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0a03d-36e6-4a8d-93f6-62c4a4b141fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f473824894f74b6b91ca630ef55c7d50, user_id=367aa5131ea94025922150d8a1926bfc, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:36.338459 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0a03d-36e6-4a8d-93f6-62c4a4b141fb admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:36.351214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1368/2735] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:36 2022] PUT /identity/v3/projects/f473824894f74b6b91ca630ef55c7d50/users/367aa5131ea94025922150d8a1926bfc/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:24:36.361406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f9698-8be7-4848-9d42-7c36987391a2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:36.361703 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f9698-8be7-4848-9d42-7c36987391a2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:36.361998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f9698-8be7-4848-9d42-7c36987391a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:36.390568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a65f9698-8be7-4848-9d42-7c36987391a2 None None] MFA Rules not processed for user `367aa5131ea94025922150d8a1926bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:36.391814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a65f9698-8be7-4848-9d42-7c36987391a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:36.448467 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:36.467737 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1368/2736] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:36.481755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0a03d-36e6-4a8d-93f6-62c4a4b141fb admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:36.483852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-78f0a03d-36e6-4a8d-93f6-62c4a4b141fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:36.556619 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0a03d-36e6-4a8d-93f6-62c4a4b141fb admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:36.560327 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4dd35-7e2a-4a79-bde8-6802b90ef2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:36.561003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4dd35-7e2a-4a79-bde8-6802b90ef2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:36.561287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4dd35-7e2a-4a79-bde8-6802b90ef2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:36.561563 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4dd35-7e2a-4a79-bde8-6802b90ef2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:36.572456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4dd35-7e2a-4a79-bde8-6802b90ef2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:36.573908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4dd35-7e2a-4a79-bde8-6802b90ef2b3 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:36.578019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:36.585205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1369/2737] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:36.655036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f9698-8be7-4848-9d42-7c36987391a2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:36.724713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f9698-8be7-4848-9d42-7c36987391a2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:36.729630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:36.730596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:36.730955 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:36.731311 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] PATH_INFO: `/v3/users/7af8b63ea4904400b959e809c0bdd5e7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:36.732999 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af8b63ea4904400b959e809c0bdd5e7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:36.735279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:36.957225 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af8b63ea4904400b959e809c0bdd5e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:36.970944 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af8b63ea4904400b959e809c0bdd5e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:36.972526 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af8b63ea4904400b959e809c0bdd5e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:36.989416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af8b63ea4904400b959e809c0bdd5e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:37.090814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af8b63ea4904400b959e809c0bdd5e7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:37.099106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1369/2738] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:36 2022] DELETE /identity/v3/users/7af8b63ea4904400b959e809c0bdd5e7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:37.105974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa93d9-903c-4645-a856-462e630eb6a3 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:37.105974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa93d9-903c-4645-a856-462e630eb6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:37.105974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa93d9-903c-4645-a856-462e630eb6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:37.128513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-e0aa93d9-903c-4645-a856-462e630eb6a3 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:37.129641 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e0aa93d9-903c-4645-a856-462e630eb6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:37.195103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1370/2739] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:37.205355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:37.207151 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:37.274721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb1190-34b2-4766-9b73-4bd3ca8b54bf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:37.278547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e170c14-992e-4d2b-b19b-4ca2815fd152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:37.279218 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170c14-992e-4d2b-b19b-4ca2815fd152 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:37.279475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170c14-992e-4d2b-b19b-4ca2815fd152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:37.279750 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e170c14-992e-4d2b-b19b-4ca2815fd152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:37.290033 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e170c14-992e-4d2b-b19b-4ca2815fd152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:37.291653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e170c14-992e-4d2b-b19b-4ca2815fd152 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:37.303468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1370/2740] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:37.774612 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa93d9-903c-4645-a856-462e630eb6a3 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:37.776130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e0aa93d9-903c-4645-a856-462e630eb6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:37.797383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa93d9-903c-4645-a856-462e630eb6a3 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:37.805521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:37.806298 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:37.806634 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:37.806852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] PATH_INFO: `/v3/projects/af7a0c113c80480389516a421c6e98be` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:37.808099 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7a0c113c80480389516a421c6e98be)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:37.810169 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:37.909977 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7a0c113c80480389516a421c6e98be', 'request_id': 'req-671d6ba3-f818-45c5-bb21-9ecd7fa72102'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:37.916881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7a0c113c80480389516a421c6e98be', 'request_id': 'req-671d6ba3-f818-45c5-bb21-9ecd7fa72102'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:37.923408 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7a0c113c80480389516a421c6e98be', 'request_id': 'req-671d6ba3-f818-45c5-bb21-9ecd7fa72102'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:38.010478 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] The token cache is being invalidate because project af7a0c113c80480389516a421c6e98be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:38.010794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:38.011448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:38.013003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1371/2741] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:37 2022] DELETE /identity/v3/projects/af7a0c113c80480389516a421c6e98be => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:38.017146 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e170c14-992e-4d2b-b19b-4ca2815fd152 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:38.027422 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e170c14-992e-4d2b-b19b-4ca2815fd152 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:38.040902 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:38.092747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:38.093630 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:38.093912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:38.094187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] PATH_INFO: `/v3/users/367aa5131ea94025922150d8a1926bfc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:38.095445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367aa5131ea94025922150d8a1926bfc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:38.097702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:38.264287 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367aa5131ea94025922150d8a1926bfc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:38.273558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367aa5131ea94025922150d8a1926bfc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:38.274281 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367aa5131ea94025922150d8a1926bfc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:38.293484 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367aa5131ea94025922150d8a1926bfc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:38.348465 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9fda4f15-62c0-412d-91a7-6918e47606c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367aa5131ea94025922150d8a1926bfc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:38.355773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1371/2742] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:38 2022] DELETE /identity/v3/users/367aa5131ea94025922150d8a1926bfc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:38.829974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:38.832171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:38.852908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d6ba3-f818-45c5-bb21-9ecd7fa72102 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:38.921079 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:38.922498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:38.922969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:38.923400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] PATH_INFO: `/v3/projects/f473824894f74b6b91ca630ef55c7d50` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:38.924957 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f473824894f74b6b91ca630ef55c7d50)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:38.927128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:38.959694 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:39.057005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f473824894f74b6b91ca630ef55c7d50', 'request_id': 'req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:39.063212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f473824894f74b6b91ca630ef55c7d50', 'request_id': 'req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:39.069000 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f473824894f74b6b91ca630ef55c7d50', 'request_id': 'req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:39.131171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] The token cache is being invalidate because project f473824894f74b6b91ca630ef55c7d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:39.131476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:39.132521 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7c3a2d5b-8bf4-434f-9853-a90cabe2190b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:39.136562 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1372/2743] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:38 2022] DELETE /identity/v3/projects/f473824894f74b6b91ca630ef55c7d50 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:39.139167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b25f-5bcf-4563-bd38-642cc3d4ce2a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:39.139562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b25f-5bcf-4563-bd38-642cc3d4ce2a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:39.139965 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210b25f-5bcf-4563-bd38-642cc3d4ce2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:39.159388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a210b25f-5bcf-4563-bd38-642cc3d4ce2a None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:39.160797 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a210b25f-5bcf-4563-bd38-642cc3d4ce2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:39.227451 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1372/2744] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:39.235333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d52a-8850-4d42-80d1-a518d90a71bd None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:39.235623 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d52a-8850-4d42-80d1-a518d90a71bd None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:39.235929 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d52a-8850-4d42-80d1-a518d90a71bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:39.255268 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f820d52a-8850-4d42-80d1-a518d90a71bd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:39.256715 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f820d52a-8850-4d42-80d1-a518d90a71bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:39.269212 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1373/2745] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:39.270524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210b25f-5bcf-4563-bd38-642cc3d4ce2a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:39.283627 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210b25f-5bcf-4563-bd38-642cc3d4ce2a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:39.288973 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638718-6f5c-4565-bf0c-21e9b89da449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:39.289637 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638718-6f5c-4565-bf0c-21e9b89da449 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:39.289923 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638718-6f5c-4565-bf0c-21e9b89da449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:39.290199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638718-6f5c-4565-bf0c-21e9b89da449 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:39.290924 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f638718-6f5c-4565-bf0c-21e9b89da449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:24:39.291232 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f638718-6f5c-4565-bf0c-21e9b89da449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:39.292864 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f638718-6f5c-4565-bf0c-21e9b89da449 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:39.305726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1373/2746] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:24:39.310242 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820d52a-8850-4d42-80d1-a518d90a71bd None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:39.320479 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820d52a-8850-4d42-80d1-a518d90a71bd None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:39.336427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd19da-9682-4591-abec-ed5d3686a84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:39.337101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd19da-9682-4591-abec-ed5d3686a84e admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:39.337387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd19da-9682-4591-abec-ed5d3686a84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:39.337667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd19da-9682-4591-abec-ed5d3686a84e admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:39.338456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd19da-9682-4591-abec-ed5d3686a84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:39.340898 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd19da-9682-4591-abec-ed5d3686a84e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:39.473180 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1374/2747] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:39 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:39.477045 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638718-6f5c-4565-bf0c-21e9b89da449 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:39.491457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638718-6f5c-4565-bf0c-21e9b89da449 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:39.525972 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:39.571666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7b720-c666-4baa-b8b5-db1b8bc884bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:39.572402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7b720-c666-4baa-b8b5-db1b8bc884bc admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:39.572685 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7b720-c666-4baa-b8b5-db1b8bc884bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:39.572957 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7b720-c666-4baa-b8b5-db1b8bc884bc admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:39.573661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7b720-c666-4baa-b8b5-db1b8bc884bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:39.575742 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7b720-c666-4baa-b8b5-db1b8bc884bc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:39.652355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1374/2748] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:39 2022] POST /identity/v3/users => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:39.656502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd19da-9682-4591-abec-ed5d3686a84e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:39.667569 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd19da-9682-4591-abec-ed5d3686a84e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:39.673878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c5b75-4614-41ac-89cb-dc83b3da40f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:39.675243 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c5b75-4614-41ac-89cb-dc83b3da40f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:39.675531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c5b75-4614-41ac-89cb-dc83b3da40f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:39.675834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c5b75-4614-41ac-89cb-dc83b3da40f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:39.676603 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c5b75-4614-41ac-89cb-dc83b3da40f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:39.678215 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c5b75-4614-41ac-89cb-dc83b3da40f7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:39.689473 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1375/2749] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:39.694108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7b720-c666-4baa-b8b5-db1b8bc884bc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:39.704617 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7b720-c666-4baa-b8b5-db1b8bc884bc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:39.709449 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c7bba-27f8-4100-ba25-6e23e867f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:39.710128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7bba-27f8-4100-ba25-6e23e867f81d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:39.710410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7bba-27f8-4100-ba25-6e23e867f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:39.710684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c7bba-27f8-4100-ba25-6e23e867f81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:39.711415 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c7bba-27f8-4100-ba25-6e23e867f81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:39.713071 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c7bba-27f8-4100-ba25-6e23e867f81d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:39.724027 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1375/2750] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:39.728361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c5b75-4614-41ac-89cb-dc83b3da40f7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:39.739637 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c5b75-4614-41ac-89cb-dc83b3da40f7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:39.744347 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde16b7-713b-42dd-a03c-0399c6fb47e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:39.745234 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde16b7-713b-42dd-a03c-0399c6fb47e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:39.745514 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde16b7-713b-42dd-a03c-0399c6fb47e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:39.745788 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde16b7-713b-42dd-a03c-0399c6fb47e4 admin admin] PATH_INFO: `/v3/projects/14adaabc2d5846218c8cc2715c3ae942/users/eabadf9ea87d4d9f8820bc2d750b90fa/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:39.763008 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde16b7-713b-42dd-a03c-0399c6fb47e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14adaabc2d5846218c8cc2715c3ae942, user_id=eabadf9ea87d4d9f8820bc2d750b90fa, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:39.765756 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde16b7-713b-42dd-a03c-0399c6fb47e4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:39.844839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1376/2751] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:39 2022] PUT /identity/v3/projects/14adaabc2d5846218c8cc2715c3ae942/users/eabadf9ea87d4d9f8820bc2d750b90fa/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:39.852661 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6de4-b4ab-4d0d-acb5-20c3b25b4f37 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:39.857980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6de4-b4ab-4d0d-acb5-20c3b25b4f37 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:39.857980 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d6de4-b4ab-4d0d-acb5-20c3b25b4f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:39.886031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-353d6de4-b4ab-4d0d-acb5-20c3b25b4f37 None None] MFA Rules not processed for user `eabadf9ea87d4d9f8820bc2d750b90fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:39.886031 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-353d6de4-b4ab-4d0d-acb5-20c3b25b4f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:39.968011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1376/2752] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:39.972222 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde16b7-713b-42dd-a03c-0399c6fb47e4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:40.039852 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde16b7-713b-42dd-a03c-0399c6fb47e4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:40.045022 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9f30-1e0c-457a-9f09-3a1d3be9222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:40.045688 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9f30-1e0c-457a-9f09-3a1d3be9222a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:40.045969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9f30-1e0c-457a-9f09-3a1d3be9222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:40.046246 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9f30-1e0c-457a-9f09-3a1d3be9222a admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:40.046948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d9f30-1e0c-457a-9f09-3a1d3be9222a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:40.049266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d9f30-1e0c-457a-9f09-3a1d3be9222a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:40.174166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1377/2753] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:39 2022] POST /identity/v3/projects => generated 397 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:40.178245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d6de4-b4ab-4d0d-acb5-20c3b25b4f37 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:40.190369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d6de4-b4ab-4d0d-acb5-20c3b25b4f37 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:40.255246 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9b037-1013-4d06-a1dd-b5a1c66250ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:40.256116 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9b037-1013-4d06-a1dd-b5a1c66250ed admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:40.256406 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9b037-1013-4d06-a1dd-b5a1c66250ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:40.256684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9b037-1013-4d06-a1dd-b5a1c66250ed admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:40.257401 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9b037-1013-4d06-a1dd-b5a1c66250ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:40.259368 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9b037-1013-4d06-a1dd-b5a1c66250ed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:40.368082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1377/2754] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:40 2022] POST /identity/v3/users => generated 305 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:40.372266 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9f30-1e0c-457a-9f09-3a1d3be9222a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:40.383457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9f30-1e0c-457a-9f09-3a1d3be9222a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:40.402325 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138fa9d-e212-4416-9456-e9836d699ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:40.403025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138fa9d-e212-4416-9456-e9836d699ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:40.403308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138fa9d-e212-4416-9456-e9836d699ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:40.403662 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138fa9d-e212-4416-9456-e9836d699ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:40.404404 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138fa9d-e212-4416-9456-e9836d699ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:40.406021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138fa9d-e212-4416-9456-e9836d699ba3 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:40.418866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1378/2755] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:40.423580 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9b037-1013-4d06-a1dd-b5a1c66250ed admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:40.435558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9b037-1013-4d06-a1dd-b5a1c66250ed admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:40.441052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37d9d2-4067-43d5-b7e5-c5e77f5b9175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:40.445488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37d9d2-4067-43d5-b7e5-c5e77f5b9175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:40.445488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37d9d2-4067-43d5-b7e5-c5e77f5b9175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:40.445488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37d9d2-4067-43d5-b7e5-c5e77f5b9175 admin admin] PATH_INFO: `/v3/projects/c3d15a310ee94f33a5e43f5a5ed520f2/users/5b7d20d8901f4c37ae4626bbaef2045f/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:40.463306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37d9d2-4067-43d5-b7e5-c5e77f5b9175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d15a310ee94f33a5e43f5a5ed520f2, user_id=5b7d20d8901f4c37ae4626bbaef2045f, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:40.466042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37d9d2-4067-43d5-b7e5-c5e77f5b9175 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:40.469245 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:40.560838 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1378/2756] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:40 2022] PUT /identity/v3/projects/c3d15a310ee94f33a5e43f5a5ed520f2/users/5b7d20d8901f4c37ae4626bbaef2045f/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:40.566168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138fa9d-e212-4416-9456-e9836d699ba3 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:40.579437 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138fa9d-e212-4416-9456-e9836d699ba3 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:40.614733 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:40.687146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e84439-a24f-45cf-922e-4aa3932e4084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:40.687146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84439-a24f-45cf-922e-4aa3932e4084 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:40.687146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84439-a24f-45cf-922e-4aa3932e4084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:40.687146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84439-a24f-45cf-922e-4aa3932e4084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:40.687672 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e84439-a24f-45cf-922e-4aa3932e4084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:40.689115 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e84439-a24f-45cf-922e-4aa3932e4084 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:40.703394 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1379/2757] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:40.704247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37d9d2-4067-43d5-b7e5-c5e77f5b9175 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:40.726316 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37d9d2-4067-43d5-b7e5-c5e77f5b9175 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:40.731160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d097d-610b-4ba4-b2e4-296bfb698fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:40.732108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d097d-610b-4ba4-b2e4-296bfb698fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:40.732397 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d097d-610b-4ba4-b2e4-296bfb698fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:40.732678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d097d-610b-4ba4-b2e4-296bfb698fe7 admin admin] PATH_INFO: `/v3/projects/c3d15a310ee94f33a5e43f5a5ed520f2/users/5b7d20d8901f4c37ae4626bbaef2045f/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:40.734717 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d097d-610b-4ba4-b2e4-296bfb698fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d15a310ee94f33a5e43f5a5ed520f2, user_id=5b7d20d8901f4c37ae4626bbaef2045f, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:40.741048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d097d-610b-4ba4-b2e4-296bfb698fe7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:40.754707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1379/2758] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:40 2022] PUT /identity/v3/projects/c3d15a310ee94f33a5e43f5a5ed520f2/users/5b7d20d8901f4c37ae4626bbaef2045f/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:24:40.765311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604a8a-be1d-4a97-92b1-0a7304fe972e None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:40.765600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604a8a-be1d-4a97-92b1-0a7304fe972e None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:40.765881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604a8a-be1d-4a97-92b1-0a7304fe972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:40.806200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-af604a8a-be1d-4a97-92b1-0a7304fe972e None None] MFA Rules not processed for user `5b7d20d8901f4c37ae4626bbaef2045f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:40.807763 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-af604a8a-be1d-4a97-92b1-0a7304fe972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:40.887964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1380/2759] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:40.899808 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d097d-610b-4ba4-b2e4-296bfb698fe7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:40.901621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-981d097d-610b-4ba4-b2e4-296bfb698fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:40.962828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d097d-610b-4ba4-b2e4-296bfb698fe7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:40.966660 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a1732-c21b-442d-86cc-8af8a98cafeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:40.967323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a1732-c21b-442d-86cc-8af8a98cafeb service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:40.967611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a1732-c21b-442d-86cc-8af8a98cafeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:40.967915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a1732-c21b-442d-86cc-8af8a98cafeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:40.978539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a1732-c21b-442d-86cc-8af8a98cafeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:40.980066 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a1732-c21b-442d-86cc-8af8a98cafeb service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:40.991746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1380/2760] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:41.167996 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af604a8a-be1d-4a97-92b1-0a7304fe972e None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:41.178168 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af604a8a-be1d-4a97-92b1-0a7304fe972e None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:41.181858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a79c80-ccf3-4db5-b7a1-ebe08d8e422c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:41.182655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a79c80-ccf3-4db5-b7a1-ebe08d8e422c service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:41.182948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a79c80-ccf3-4db5-b7a1-ebe08d8e422c service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:41.183225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a79c80-ccf3-4db5-b7a1-ebe08d8e422c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:41.244163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a79c80-ccf3-4db5-b7a1-ebe08d8e422c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:41.245695 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a79c80-ccf3-4db5-b7a1-ebe08d8e422c service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:41.255682 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1381/2761] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 12:24:46.648126 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a1732-c21b-442d-86cc-8af8a98cafeb service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:46.720144 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a1732-c21b-442d-86cc-8af8a98cafeb service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:46.724938 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:46.725815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:46.726095 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:46.726372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] PATH_INFO: `/v3/users/eabadf9ea87d4d9f8820bc2d750b90fa` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:46.727614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabadf9ea87d4d9f8820bc2d750b90fa)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:46.729619 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:46.861304 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabadf9ea87d4d9f8820bc2d750b90fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:46.869290 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabadf9ea87d4d9f8820bc2d750b90fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:46.869992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabadf9ea87d4d9f8820bc2d750b90fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:46.882903 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabadf9ea87d4d9f8820bc2d750b90fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:46.935772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabadf9ea87d4d9f8820bc2d750b90fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:46.943789 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1381/2762] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:46 2022] DELETE /identity/v3/users/eabadf9ea87d4d9f8820bc2d750b90fa => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:46.948335 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989a02-5006-4cdd-a4b9-d1cf8c800781 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:46.948846 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989a02-5006-4cdd-a4b9-d1cf8c800781 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:46.948960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f989a02-5006-4cdd-a4b9-d1cf8c800781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:46.965666 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2f989a02-5006-4cdd-a4b9-d1cf8c800781 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:46.966871 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2f989a02-5006-4cdd-a4b9-d1cf8c800781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:47.004862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:47.025928 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1382/2763] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:47.036153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:47.037638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:47.042943 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:47.096395 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33034-bbbf-44df-a8fb-fb42a4e6e560 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:47.100048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3c44b-51ed-4a7c-9def-9e4e299b71ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:47.100692 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3c44b-51ed-4a7c-9def-9e4e299b71ab service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:47.100974 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3c44b-51ed-4a7c-9def-9e4e299b71ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:47.101250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3c44b-51ed-4a7c-9def-9e4e299b71ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:47.110135 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3c44b-51ed-4a7c-9def-9e4e299b71ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:47.111578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3c44b-51ed-4a7c-9def-9e4e299b71ab service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:47.121849 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1382/2764] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:48.219130 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989a02-5006-4cdd-a4b9-d1cf8c800781 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:48.222954 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2f989a02-5006-4cdd-a4b9-d1cf8c800781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:48.240999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f989a02-5006-4cdd-a4b9-d1cf8c800781 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:48.247100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:48.248232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:48.248579 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:48.249441 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] PATH_INFO: `/v3/projects/14adaabc2d5846218c8cc2715c3ae942` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:48.250705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=14adaabc2d5846218c8cc2715c3ae942)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:48.253304 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:48.387361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14adaabc2d5846218c8cc2715c3ae942', 'request_id': 'req-70a62089-ef70-412a-a474-fb6611ad1d4b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.394638 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14adaabc2d5846218c8cc2715c3ae942', 'request_id': 'req-70a62089-ef70-412a-a474-fb6611ad1d4b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.400772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14adaabc2d5846218c8cc2715c3ae942', 'request_id': 'req-70a62089-ef70-412a-a474-fb6611ad1d4b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.479140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] The token cache is being invalidate because project 14adaabc2d5846218c8cc2715c3ae942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:48.479430 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.480084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.481631 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1383/2765] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:48 2022] DELETE /identity/v3/projects/14adaabc2d5846218c8cc2715c3ae942 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:48.485746 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3c44b-51ed-4a7c-9def-9e4e299b71ab service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:48.495412 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3c44b-51ed-4a7c-9def-9e4e299b71ab service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:48.561140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:48.562004 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:48.562286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:48.562558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] PATH_INFO: `/v3/users/5b7d20d8901f4c37ae4626bbaef2045f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:48.563714 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7d20d8901f4c37ae4626bbaef2045f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:48.565653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:48.743969 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7d20d8901f4c37ae4626bbaef2045f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.751005 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7d20d8901f4c37ae4626bbaef2045f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.751671 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7d20d8901f4c37ae4626bbaef2045f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.763861 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7d20d8901f4c37ae4626bbaef2045f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.855668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc49981a-3973-463b-b17e-55a5ecb9f724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7d20d8901f4c37ae4626bbaef2045f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:48.862257 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1383/2766] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:24:48 2022] DELETE /identity/v3/users/5b7d20d8901f4c37ae4626bbaef2045f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:49.297448 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:49.298906 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:49.313129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a62089-ef70-412a-a474-fb6611ad1d4b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:49.374862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:49.376513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:49.376513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:49.376513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] PATH_INFO: `/v3/projects/c3d15a310ee94f33a5e43f5a5ed520f2` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:49.377624 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d15a310ee94f33a5e43f5a5ed520f2)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:49.379535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:49.473982 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d15a310ee94f33a5e43f5a5ed520f2', 'request_id': 'req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:49.480006 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d15a310ee94f33a5e43f5a5ed520f2', 'request_id': 'req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:49.485433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d15a310ee94f33a5e43f5a5ed520f2', 'request_id': 'req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:49.489003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:49.582025 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] The token cache is being invalidate because project c3d15a310ee94f33a5e43f5a5ed520f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:24:49.582307 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:49.582927 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-3754eb04-0c0d-4878-bec2-f42cb1fe2fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:24:49.584540 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1384/2767] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:24:49 2022] DELETE /identity/v3/projects/c3d15a310ee94f33a5e43f5a5ed520f2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:49.589396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5241e-7f61-4aca-9120-0f5393800adc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:49.589854 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5241e-7f61-4aca-9120-0f5393800adc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:49.589966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5241e-7f61-4aca-9120-0f5393800adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:49.609339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-afd5241e-7f61-4aca-9120-0f5393800adc None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:49.610549 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-afd5241e-7f61-4aca-9120-0f5393800adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:49.629862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:49.670678 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1384/2768] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:49.682421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4da4c-17c4-48d2-bb48-e9793a6a18e2 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:49.682768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4da4c-17c4-48d2-bb48-e9793a6a18e2 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:49.683065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4da4c-17c4-48d2-bb48-e9793a6a18e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:49.708605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-5ef4da4c-17c4-48d2-bb48-e9793a6a18e2 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:49.708605 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-5ef4da4c-17c4-48d2-bb48-e9793a6a18e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:49.711365 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1385/2769] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:49.715490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5241e-7f61-4aca-9120-0f5393800adc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:49.726993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5241e-7f61-4aca-9120-0f5393800adc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:49.732175 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed81ab-3c57-4fbb-a42e-f3fdcb421aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:49.732324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed81ab-3c57-4fbb-a42e-f3fdcb421aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:49.732579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed81ab-3c57-4fbb-a42e-f3fdcb421aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:49.732878 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed81ab-3c57-4fbb-a42e-f3fdcb421aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:49.733596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed81ab-3c57-4fbb-a42e-f3fdcb421aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:24:49.733904 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed81ab-3c57-4fbb-a42e-f3fdcb421aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:49.735531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed81ab-3c57-4fbb-a42e-f3fdcb421aa6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:49.748247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1385/2770] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:24:49.752531 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4da4c-17c4-48d2-bb48-e9793a6a18e2 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:49.761869 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4da4c-17c4-48d2-bb48-e9793a6a18e2 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:49.766498 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa66719-b8e2-4f02-9447-875e5ef8b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:49.767145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66719-b8e2-4f02-9447-875e5ef8b4aa admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:49.767426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66719-b8e2-4f02-9447-875e5ef8b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:49.767704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66719-b8e2-4f02-9447-875e5ef8b4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:49.768564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa66719-b8e2-4f02-9447-875e5ef8b4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:49.770466 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa66719-b8e2-4f02-9447-875e5ef8b4aa admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:49.839908 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1386/2771] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:24:49 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:49.844037 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed81ab-3c57-4fbb-a42e-f3fdcb421aa6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:49.856426 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed81ab-3c57-4fbb-a42e-f3fdcb421aa6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:49.918612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44eab-1c77-4de9-a8f1-7b83ad73b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:49.919283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44eab-1c77-4de9-a8f1-7b83ad73b4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:49.919571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44eab-1c77-4de9-a8f1-7b83ad73b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:49.919851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44eab-1c77-4de9-a8f1-7b83ad73b4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:49.920567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e44eab-1c77-4de9-a8f1-7b83ad73b4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:49.922790 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e44eab-1c77-4de9-a8f1-7b83ad73b4e7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:50.042760 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1386/2772] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:24:49 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:24:50.044087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa66719-b8e2-4f02-9447-875e5ef8b4aa admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:50.054525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa66719-b8e2-4f02-9447-875e5ef8b4aa admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:50.059138 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b7556-e228-4746-a72b-57599a7fd0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:50.059789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7556-e228-4746-a72b-57599a7fd0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:50.060098 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7556-e228-4746-a72b-57599a7fd0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:50.060373 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b7556-e228-4746-a72b-57599a7fd0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:50.061092 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b7556-e228-4746-a72b-57599a7fd0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:50.062691 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b7556-e228-4746-a72b-57599a7fd0b6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:50.073292 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1387/2773] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:24:50.079108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44eab-1c77-4de9-a8f1-7b83ad73b4e7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:50.089979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44eab-1c77-4de9-a8f1-7b83ad73b4e7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:50.094570 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7490f-485c-474b-ad9b-f6e307af72b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:50.095237 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7490f-485c-474b-ad9b-f6e307af72b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:50.095524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7490f-485c-474b-ad9b-f6e307af72b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:50.095801 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7490f-485c-474b-ad9b-f6e307af72b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:50.097215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7490f-485c-474b-ad9b-f6e307af72b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:50.099385 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7490f-485c-474b-ad9b-f6e307af72b4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:50.109137 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1387/2774] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:24:50.113326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b7556-e228-4746-a72b-57599a7fd0b6 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:50.123364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b7556-e228-4746-a72b-57599a7fd0b6 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:50.128121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6725d55-71ff-4295-8d3f-d243865dd0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:50.129018 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6725d55-71ff-4295-8d3f-d243865dd0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:50.129410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6725d55-71ff-4295-8d3f-d243865dd0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:50.129719 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6725d55-71ff-4295-8d3f-d243865dd0f7 admin admin] PATH_INFO: `/v3/projects/62ee0a796b534e0982e8a578ea95fabc/users/d25027fada9c4c6a8ce0418b010313fa/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:50.145333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6725d55-71ff-4295-8d3f-d243865dd0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ee0a796b534e0982e8a578ea95fabc, user_id=d25027fada9c4c6a8ce0418b010313fa, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:50.148014 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6725d55-71ff-4295-8d3f-d243865dd0f7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:50.222794 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1388/2775] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:24:50 2022] PUT /identity/v3/projects/62ee0a796b534e0982e8a578ea95fabc/users/d25027fada9c4c6a8ce0418b010313fa/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:24:50.227765 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9540-4190-40e4-83d8-9ad55f287e65 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:50.228155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9540-4190-40e4-83d8-9ad55f287e65 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:50.228442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b9540-4190-40e4-83d8-9ad55f287e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:50.246739 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1c4b9540-4190-40e4-83d8-9ad55f287e65 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:50.247979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1c4b9540-4190-40e4-83d8-9ad55f287e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:50.311023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1388/2776] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:24:50.321164 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6725d55-71ff-4295-8d3f-d243865dd0f7 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:50.322942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-e6725d55-71ff-4295-8d3f-d243865dd0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:50.383922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6725d55-71ff-4295-8d3f-d243865dd0f7 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:50.383922 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132880e1-4524-45c4-b9f4-bf14bd2e1bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:50.384589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132880e1-4524-45c4-b9f4-bf14bd2e1bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:50.384874 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132880e1-4524-45c4-b9f4-bf14bd2e1bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:50.385153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132880e1-4524-45c4-b9f4-bf14bd2e1bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:50.394283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132880e1-4524-45c4-b9f4-bf14bd2e1bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:50.395787 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132880e1-4524-45c4-b9f4-bf14bd2e1bf6 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:50.405245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1389/2777] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:51.646389 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e7b32-5da0-4df8-9b97-cc44e6af7ff8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:51.646937 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e7b32-5da0-4df8-9b97-cc44e6af7ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:51.646937 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e7b32-5da0-4df8-9b97-cc44e6af7ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:51.677270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2a6e7b32-5da0-4df8-9b97-cc44e6af7ff8 None None] MFA Rules not processed for user `d25027fada9c4c6a8ce0418b010313fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:51.678533 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2a6e7b32-5da0-4df8-9b97-cc44e6af7ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:51.697693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:51.748604 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1389/2778] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:24:51.759773 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132880e1-4524-45c4-b9f4-bf14bd2e1bf6 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:51.761559 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-132880e1-4524-45c4-b9f4-bf14bd2e1bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:51.822227 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132880e1-4524-45c4-b9f4-bf14bd2e1bf6 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:51.825902 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a330d8-2b61-4611-993a-7cd6f1f24f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:51.826564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a330d8-2b61-4611-993a-7cd6f1f24f7c service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:51.826847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a330d8-2b61-4611-993a-7cd6f1f24f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:51.827127 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a330d8-2b61-4611-993a-7cd6f1f24f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:51.836343 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a330d8-2b61-4611-993a-7cd6f1f24f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:51.837807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a330d8-2b61-4611-993a-7cd6f1f24f7c service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:51.847700 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1390/2779] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:53.482940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e13148-51cf-4bec-b1db-ca0aafbeab86 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:53.483444 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e13148-51cf-4bec-b1db-ca0aafbeab86 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:53.483581 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e13148-51cf-4bec-b1db-ca0aafbeab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:53.506209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-50e13148-51cf-4bec-b1db-ca0aafbeab86 None None] MFA Rules not processed for user `d25027fada9c4c6a8ce0418b010313fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:24:53.506209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-50e13148-51cf-4bec-b1db-ca0aafbeab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:53.513862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1390/2780] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:24:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:24:53.965976 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a330d8-2b61-4611-993a-7cd6f1f24f7c service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:53.971205 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-56a330d8-2b61-4611-993a-7cd6f1f24f7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:53.980053 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a330d8-2b61-4611-993a-7cd6f1f24f7c service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:53.983740 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:53.984583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:53.984945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:53.985285 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:53.987820 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:53.997867 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:53.999297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:54.007608 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1391/2781] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:54.811417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e13148-51cf-4bec-b1db-ca0aafbeab86 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:54.812961 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-50e13148-51cf-4bec-b1db-ca0aafbeab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:54.863786 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:24:54.870542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:54.919019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:24:54.963418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e13148-51cf-4bec-b1db-ca0aafbeab86 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:54.969061 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06babc39-ded6-40f1-a538-420545db000f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:54.969713 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06babc39-ded6-40f1-a538-420545db000f service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:54.969998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06babc39-ded6-40f1-a538-420545db000f service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:54.970279 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06babc39-ded6-40f1-a538-420545db000f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:54.972756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-06babc39-ded6-40f1-a538-420545db000f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:54.981780 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae699c-0568-4d2d-b7b8-f29269b07a5b service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:24:54.993790 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9194fc9-21ba-4833-b0f0-585a315f024b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:24:54.994028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06babc39-ded6-40f1-a538-420545db000f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:54.994462 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9194fc9-21ba-4833-b0f0-585a315f024b service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:24:54.994748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9194fc9-21ba-4833-b0f0-585a315f024b service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:24:54.995028 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9194fc9-21ba-4833-b0f0-585a315f024b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:24:54.995848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06babc39-ded6-40f1-a538-420545db000f service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:54.996974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f9194fc9-21ba-4833-b0f0-585a315f024b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:24:55.008132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1391/2782] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:24:55.013241 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9194fc9-21ba-4833-b0f0-585a315f024b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:24:55.014911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9194fc9-21ba-4833-b0f0-585a315f024b service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:24:55.027380 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1392/2783] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:25:00.189222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6eac-75e1-4e98-910e-323a20296d98 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:00.192596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6eac-75e1-4e98-910e-323a20296d98 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:00.192596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed6eac-75e1-4e98-910e-323a20296d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:00.207256 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f5ed6eac-75e1-4e98-910e-323a20296d98 None None] MFA Rules not processed for user `e95a1f9496564c2783c228929fdbcb32`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:25:00.208525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f5ed6eac-75e1-4e98-910e-323a20296d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:25:00.263662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1392/2784] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:25:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:25:00.568932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9194fc9-21ba-4833-b0f0-585a315f024b service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:25:00.578267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9194fc9-21ba-4833-b0f0-585a315f024b service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:25:00.582574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262013f-966c-4d26-bf4e-7d130dcb158f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:25:00.739840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262013f-966c-4d26-bf4e-7d130dcb158f service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:00.739840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262013f-966c-4d26-bf4e-7d130dcb158f service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:00.739840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262013f-966c-4d26-bf4e-7d130dcb158f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:00.739840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4262013f-966c-4d26-bf4e-7d130dcb158f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:25:00.739840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262013f-966c-4d26-bf4e-7d130dcb158f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:25:00.739840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262013f-966c-4d26-bf4e-7d130dcb158f service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:25:00.742004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1393/2785] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:25:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:25:05.700209 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed6eac-75e1-4e98-910e-323a20296d98 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:25:05.710361 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed6eac-75e1-4e98-910e-323a20296d98 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:25:05.714576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd5687-2338-4409-86e8-d200f44bff66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:25:05.715505 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd5687-2338-4409-86e8-d200f44bff66 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:05.716088 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd5687-2338-4409-86e8-d200f44bff66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:05.716540 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd5687-2338-4409-86e8-d200f44bff66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:05.718656 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0cd5687-2338-4409-86e8-d200f44bff66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:25:05.780536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:25:05.806998 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd5687-2338-4409-86e8-d200f44bff66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:25:05.808968 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd5687-2338-4409-86e8-d200f44bff66 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:25:05.816354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262013f-966c-4d26-bf4e-7d130dcb158f service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:25:05.845616 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1393/2786] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:25:05.849796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262013f-966c-4d26-bf4e-7d130dcb158f service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:25:05.858325 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c9631-eea0-4f57-888c-84685b0b536b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:25:05.859050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c9631-eea0-4f57-888c-84685b0b536b service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:05.859587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c9631-eea0-4f57-888c-84685b0b536b service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:05.860274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c9631-eea0-4f57-888c-84685b0b536b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:05.864264 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-482c9631-eea0-4f57-888c-84685b0b536b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:25:05.884570 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c9631-eea0-4f57-888c-84685b0b536b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:25:05.887060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c9631-eea0-4f57-888c-84685b0b536b service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:25:05.901955 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1394/2787] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:25:15.855357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:25:15.895475 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=33 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:25:15.908479 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474826fb-a6ca-472a-87eb-907ea1ff99a2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:15.913598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474826fb-a6ca-472a-87eb-907ea1ff99a2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:15.913598 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474826fb-a6ca-472a-87eb-907ea1ff99a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:15.926763 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-474826fb-a6ca-472a-87eb-907ea1ff99a2 None None] MFA Rules not processed for user `d25027fada9c4c6a8ce0418b010313fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:25:15.928041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-474826fb-a6ca-472a-87eb-907ea1ff99a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:25:15.935326 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1394/2788] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:25:25.921424 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:25:37.588652 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6108bc-1329-4d0d-9f7e-d93c67434f4a None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:37.589154 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6108bc-1329-4d0d-9f7e-d93c67434f4a None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:37.589261 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6108bc-1329-4d0d-9f7e-d93c67434f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:37.607646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1f6108bc-1329-4d0d-9f7e-d93c67434f4a None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:25:37.608889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1f6108bc-1329-4d0d-9f7e-d93c67434f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:25:37.666134 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1395/2789] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:25:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:25:37.707120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474826fb-a6ca-472a-87eb-907ea1ff99a2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:25:37.708758 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-474826fb-a6ca-472a-87eb-907ea1ff99a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:25:37.781446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474826fb-a6ca-472a-87eb-907ea1ff99a2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:25:37.786241 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547046e-4e3c-4c2d-bb37-b4bf1bee72b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:25:37.786882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547046e-4e3c-4c2d-bb37-b4bf1bee72b4 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:37.787166 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547046e-4e3c-4c2d-bb37-b4bf1bee72b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:37.787440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547046e-4e3c-4c2d-bb37-b4bf1bee72b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:37.795674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547046e-4e3c-4c2d-bb37-b4bf1bee72b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:25:37.797298 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547046e-4e3c-4c2d-bb37-b4bf1bee72b4 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:25:37.805801 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1395/2790] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:25:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:25:47.659244 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=25 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:25:47.802191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=32 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:25:54.068145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b04cf-ef43-4bc6-84df-df300cd6b50b None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:54.068675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b04cf-ef43-4bc6-84df-df300cd6b50b None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:54.068675 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b04cf-ef43-4bc6-84df-df300cd6b50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:54.086505 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-731b04cf-ef43-4bc6-84df-df300cd6b50b None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:25:54.087761 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-731b04cf-ef43-4bc6-84df-df300cd6b50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:25:54.094935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1396/2791] 10.222.0.49 () {58 vars in 967 bytes} [Tue Jun 28 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:25:54.107408 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547046e-4e3c-4c2d-bb37-b4bf1bee72b4 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:25:54.117831 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547046e-4e3c-4c2d-bb37-b4bf1bee72b4 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:25:54.123755 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53246c0-ff80-4a9e-9ec3-54b6d261fecb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:25:54.124446 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53246c0-ff80-4a9e-9ec3-54b6d261fecb service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:54.124733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53246c0-ff80-4a9e-9ec3-54b6d261fecb service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:54.125013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53246c0-ff80-4a9e-9ec3-54b6d261fecb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:54.133191 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53246c0-ff80-4a9e-9ec3-54b6d261fecb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:25:54.134987 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53246c0-ff80-4a9e-9ec3-54b6d261fecb service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:25:54.143016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1396/2792] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:25:57.129934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b04cf-ef43-4bc6-84df-df300cd6b50b None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:25:57.142764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b04cf-ef43-4bc6-84df-df300cd6b50b None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:25:57.147387 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:25:57.148490 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:57.148755 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:57.149023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] PATH_INFO: `/v3/users/d25027fada9c4c6a8ce0418b010313fa` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:57.150210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25027fada9c4c6a8ce0418b010313fa)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:25:57.152881 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:25:57.279147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25027fada9c4c6a8ce0418b010313fa'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.285834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25027fada9c4c6a8ce0418b010313fa'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.334031 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25027fada9c4c6a8ce0418b010313fa'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.334651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25027fada9c4c6a8ce0418b010313fa'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.347358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25027fada9c4c6a8ce0418b010313fa'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.353504 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1397/2793] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:25:57 2022] DELETE /identity/v3/users/d25027fada9c4c6a8ce0418b010313fa => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:25:57.587807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53246c0-ff80-4a9e-9ec3-54b6d261fecb service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:25:57.599217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53246c0-ff80-4a9e-9ec3-54b6d261fecb service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:25:57.662340 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:25:57.663198 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:25:57.663481 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:25:57.663756 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] PATH_INFO: `/v3/projects/62ee0a796b534e0982e8a578ea95fabc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:25:57.664990 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ee0a796b534e0982e8a578ea95fabc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:25:57.666994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:25:57.774528 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ee0a796b534e0982e8a578ea95fabc', 'request_id': 'req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.836951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ee0a796b534e0982e8a578ea95fabc', 'request_id': 'req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.844357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ee0a796b534e0982e8a578ea95fabc', 'request_id': 'req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.855159 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] The token cache is being invalidate because project 62ee0a796b534e0982e8a578ea95fabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:25:57.855436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.856112 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c32e180f-d9aa-4c91-a1a0-f1dcd051c776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:25:57.857653 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1397/2794] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:25:57 2022] DELETE /identity/v3/projects/62ee0a796b534e0982e8a578ea95fabc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:26:07.349802 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:26:07.852012 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:26:34.808529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:26:34.809935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:26:34.937512 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d93082-128c-4f7f-80bb-52d2d2db0798 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:26:35.001170 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:26:35.001823 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:26:35.002111 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:26:35.002390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:26:35.004249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:26:35.051727 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=100 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:26:35.070280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:26:35.070280 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:26:35.074899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1398/2795] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:26:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:26:45.087992 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=6 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:26:56.130837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7b034-6351-403f-a015-aa48bda5e8fa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:26:56.131345 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7b034-6351-403f-a015-aa48bda5e8fa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:26:56.131447 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7b034-6351-403f-a015-aa48bda5e8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:26:56.158683 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d8e7b034-6351-403f-a015-aa48bda5e8fa None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:26:56.159921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d8e7b034-6351-403f-a015-aa48bda5e8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:26:56.222349 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1398/2796] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:26:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:26:56.361005 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:26:56.362483 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:26:56.432118 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252e7f1-df8b-43a8-9ef3-0928ad08456f service nova] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:26:56.437011 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd16ff-a184-4c9d-bf6e-9509f41d53ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:26:56.437655 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd16ff-a184-4c9d-bf6e-9509f41d53ab service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:26:56.437984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd16ff-a184-4c9d-bf6e-9509f41d53ab service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:26:56.438257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd16ff-a184-4c9d-bf6e-9509f41d53ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:26:56.446245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd16ff-a184-4c9d-bf6e-9509f41d53ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:26:56.447831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd16ff-a184-4c9d-bf6e-9509f41d53ab service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:26:56.455959 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1399/2797] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:26:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:27:06.215078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=32 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:27:06.452650 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=32 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:27:14.097188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7b034-6351-403f-a015-aa48bda5e8fa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:14.098733 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d8e7b034-6351-403f-a015-aa48bda5e8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:14.181772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7b034-6351-403f-a015-aa48bda5e8fa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:14.185571 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1584e5d-6ab8-4a41-a98b-393fd075ca79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:14.186222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1584e5d-6ab8-4a41-a98b-393fd075ca79 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:14.186497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1584e5d-6ab8-4a41-a98b-393fd075ca79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:14.186768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1584e5d-6ab8-4a41-a98b-393fd075ca79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:14.188699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c1584e5d-6ab8-4a41-a98b-393fd075ca79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:14.200107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1584e5d-6ab8-4a41-a98b-393fd075ca79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:14.201545 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1584e5d-6ab8-4a41-a98b-393fd075ca79 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:14.210572 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1399/2798] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:27:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:27:14.592630 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd28188-26b9-4d70-87bf-eb3d0ea7efeb None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:14.593217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd28188-26b9-4d70-87bf-eb3d0ea7efeb None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:14.593217 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd28188-26b9-4d70-87bf-eb3d0ea7efeb None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:14.594574 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1400/2799] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:27:14.600539 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaef52-dd82-47bc-86a0-9a88aab0a6df None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:14.600825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaef52-dd82-47bc-86a0-9a88aab0a6df None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:14.601099 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaef52-dd82-47bc-86a0-9a88aab0a6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:14.644186 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fbeaef52-dd82-47bc-86a0-9a88aab0a6df None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:27:14.645544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fbeaef52-dd82-47bc-86a0-9a88aab0a6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:14.665664 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1400/2800] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:27:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:27:14.676997 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd28188-26b9-4d70-87bf-eb3d0ea7efeb None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:14.679611 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-cbd28188-26b9-4d70-87bf-eb3d0ea7efeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:14.736829 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd28188-26b9-4d70-87bf-eb3d0ea7efeb None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:14.741141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843cd23-4c73-4920-9090-1fe740af0dea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6784d862961b44f48b385bec777ac439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:14.741782 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843cd23-4c73-4920-9090-1fe740af0dea service glance] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:14.742063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843cd23-4c73-4920-9090-1fe740af0dea service glance] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:14.742337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843cd23-4c73-4920-9090-1fe740af0dea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:14.752466 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843cd23-4c73-4920-9090-1fe740af0dea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:14.753847 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843cd23-4c73-4920-9090-1fe740af0dea service glance] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:14.765103 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1401/2801] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:27:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:27:14.952413 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc6d48-9992-4d02-93b5-d7623317c007 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:14.952702 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc6d48-9992-4d02-93b5-d7623317c007 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:14.952981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc6d48-9992-4d02-93b5-d7623317c007 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:14.954363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1401/2802] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:27:14.960385 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d649-a8ce-4fa6-a162-3995346e5e9f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:14.960678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d649-a8ce-4fa6-a162-3995346e5e9f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:14.960958 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d649-a8ce-4fa6-a162-3995346e5e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:14.996990 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-d4a8d649-a8ce-4fa6-a162-3995346e5e9f None None] MFA Rules not processed for user `3ff61c1fbdf34fa38588e4cd2cdc5398`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:27:14.998202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d4a8d649-a8ce-4fa6-a162-3995346e5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:15.004742 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1402/2803] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:27:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:27:15.017189 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc6d48-9992-4d02-93b5-d7623317c007 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:15.029145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc6d48-9992-4d02-93b5-d7623317c007 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:15.032811 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5064303-59b8-4bb7-9d2e-9f6a941b9fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:15.033442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5064303-59b8-4bb7-9d2e-9f6a941b9fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:15.033722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5064303-59b8-4bb7-9d2e-9f6a941b9fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:15.034050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5064303-59b8-4bb7-9d2e-9f6a941b9fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:15.042039 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5064303-59b8-4bb7-9d2e-9f6a941b9fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:15.043721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5064303-59b8-4bb7-9d2e-9f6a941b9fe9 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:15.051738 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1402/2804] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:27:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:27:15.135553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619d1c1-b31a-4583-9b2e-5501911cfe49 None None] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:15.135841 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619d1c1-b31a-4583-9b2e-5501911cfe49 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:15.136145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619d1c1-b31a-4583-9b2e-5501911cfe49 None None] PATH_INFO: `/` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:15.137534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1403/2805] 10.222.0.49 () {54 vars in 921 bytes} [Tue Jun 28 12:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 12:27:15.142754 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159c3b-ce7d-4887-941e-f741626e4dfc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:15.143199 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159c3b-ce7d-4887-941e-f741626e4dfc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:15.143308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6159c3b-ce7d-4887-941e-f741626e4dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:15.165056 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c6159c3b-ce7d-4887-941e-f741626e4dfc None None] MFA Rules not processed for user `fbfe6b7a82f746169a39976be263aa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:27:15.166268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c6159c3b-ce7d-4887-941e-f741626e4dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:15.175731 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1403/2806] 10.222.0.49 () {58 vars in 1018 bytes} [Tue Jun 28 12:27:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:27:15.185960 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619d1c1-b31a-4583-9b2e-5501911cfe49 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:15.197581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619d1c1-b31a-4583-9b2e-5501911cfe49 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:15.201214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea7e9f-e632-4205-a567-97c7b234d160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:15.201843 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7e9f-e632-4205-a567-97c7b234d160 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:15.202128 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7e9f-e632-4205-a567-97c7b234d160 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:15.202407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7e9f-e632-4205-a567-97c7b234d160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:15.213100 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea7e9f-e632-4205-a567-97c7b234d160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:15.214535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea7e9f-e632-4205-a567-97c7b234d160 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:15.225163 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1404/2807] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:27:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:27:17.501145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12ffc-b996-46d4-ab1f-8d7db2a51c42 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:17.501615 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12ffc-b996-46d4-ab1f-8d7db2a51c42 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:17.501712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12ffc-b996-46d4-ab1f-8d7db2a51c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:17.519128 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a0b12ffc-b996-46d4-ab1f-8d7db2a51c42 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:27:17.520355 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a0b12ffc-b996-46d4-ab1f-8d7db2a51c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:17.528357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1404/2808] 10.222.0.49 () {58 vars in 1009 bytes} [Tue Jun 28 12:27:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:27:17.540581 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea7e9f-e632-4205-a567-97c7b234d160 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:17.551993 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea7e9f-e632-4205-a567-97c7b234d160 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:17.557286 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb59be-21cd-4635-baba-d46aac4628e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:17.557913 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb59be-21cd-4635-baba-d46aac4628e1 service swift] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:17.558192 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb59be-21cd-4635-baba-d46aac4628e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:17.558465 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb59be-21cd-4635-baba-d46aac4628e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:17.566311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb59be-21cd-4635-baba-d46aac4628e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:17.567948 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb59be-21cd-4635-baba-d46aac4628e1 service swift] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:17.575952 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1405/2809] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:27:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:27:24.854610 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12ffc-b996-46d4-ab1f-8d7db2a51c42 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:24.856688 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a0b12ffc-b996-46d4-ab1f-8d7db2a51c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:24.884049 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12ffc-b996-46d4-ab1f-8d7db2a51c42 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:24.897567 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ae8ec-3fb3-4a4d-9227-23a06986ee03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbfe6b7a82f746169a39976be263aa29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:24.898531 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ae8ec-3fb3-4a4d-9227-23a06986ee03 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:24.899072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ae8ec-3fb3-4a4d-9227-23a06986ee03 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:24.899519 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ae8ec-3fb3-4a4d-9227-23a06986ee03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:24.904921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4c3ae8ec-3fb3-4a4d-9227-23a06986ee03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:24.926339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ae8ec-3fb3-4a4d-9227-23a06986ee03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:24.928877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ae8ec-3fb3-4a4d-9227-23a06986ee03 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:24.954132 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1405/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:27:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:27:27.572696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=47 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:27:34.937698 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=69 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:27:39.167657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d4607-40fa-4572-a907-934eea2d87e8 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:39.168147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d4607-40fa-4572-a907-934eea2d87e8 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:39.168245 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d4607-40fa-4572-a907-934eea2d87e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:39.186384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2c2d4607-40fa-4572-a907-934eea2d87e8 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:27:39.187566 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2c2d4607-40fa-4572-a907-934eea2d87e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:39.194768 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1406/2811] 10.222.0.49 () {58 vars in 967 bytes} [Tue Jun 28 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:27:39.206822 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ae8ec-3fb3-4a4d-9227-23a06986ee03 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:39.219055 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ae8ec-3fb3-4a4d-9227-23a06986ee03 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:39.224150 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b23fa-7bf8-4041-8534-5a78aeabdae2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:39.225470 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b23fa-7bf8-4041-8534-5a78aeabdae2 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:39.225747 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b23fa-7bf8-4041-8534-5a78aeabdae2 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:39.226025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b23fa-7bf8-4041-8534-5a78aeabdae2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:39.234121 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b23fa-7bf8-4041-8534-5a78aeabdae2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:39.235622 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b23fa-7bf8-4041-8534-5a78aeabdae2 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:39.243814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1406/2812] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:27:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 12:27:40.248552 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025cd36-8d8c-4d5f-9ad4-7038d97a52c6 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:40.249026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025cd36-8d8c-4d5f-9ad4-7038d97a52c6 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:40.249026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025cd36-8d8c-4d5f-9ad4-7038d97a52c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:40.269125 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-1025cd36-8d8c-4d5f-9ad4-7038d97a52c6 None None] MFA Rules not processed for user `a633011057f643218e20293412f8108f`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:27:40.270341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1025cd36-8d8c-4d5f-9ad4-7038d97a52c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:40.278583 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1407/2813] 10.222.0.49 () {58 vars in 967 bytes} [Tue Jun 28 12:27:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:27:40.292995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b23fa-7bf8-4041-8534-5a78aeabdae2 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:40.304398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b23fa-7bf8-4041-8534-5a78aeabdae2 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:40.309402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18804-d10e-4a28-b1c8-0b53e11ee758 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e90e70937d49c8a35928fcfc90972d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:40.310038 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18804-d10e-4a28-b1c8-0b53e11ee758 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:40.310322 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18804-d10e-4a28-b1c8-0b53e11ee758 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:40.310601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18804-d10e-4a28-b1c8-0b53e11ee758 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:40.319508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e18804-d10e-4a28-b1c8-0b53e11ee758 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:40.321169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e18804-d10e-4a28-b1c8-0b53e11ee758 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:40.329318 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1407/2814] 10.222.0.49 () {60 vars in 1384 bytes} [Tue Jun 28 12:27:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 12:27:48.602038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025cd36-8d8c-4d5f-9ad4-7038d97a52c6 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:48.603513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-1025cd36-8d8c-4d5f-9ad4-7038d97a52c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:48.702183 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025cd36-8d8c-4d5f-9ad4-7038d97a52c6 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:48.706757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:48.707607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:48.707919 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:48.708267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] PATH_INFO: `/v3/users/cfb7784198144f248a81e9e2c09b6878` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:48.709636 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb7784198144f248a81e9e2c09b6878)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:48.711553 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:48.907899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb7784198144f248a81e9e2c09b6878'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:48.917061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb7784198144f248a81e9e2c09b6878'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:48.986984 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb7784198144f248a81e9e2c09b6878'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:48.987747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb7784198144f248a81e9e2c09b6878'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.000676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb7784198144f248a81e9e2c09b6878'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.006909 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1408/2815] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:27:48 2022] DELETE /identity/v3/users/cfb7784198144f248a81e9e2c09b6878 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:27:49.309070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18804-d10e-4a28-b1c8-0b53e11ee758 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:49.330289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18804-d10e-4a28-b1c8-0b53e11ee758 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:49.401072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:49.401940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:49.402217 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:49.402487 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] PATH_INFO: `/v3/projects/27366b4e0d1746a8a4aa96f7d8ff4061` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:49.403738 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27366b4e0d1746a8a4aa96f7d8ff4061)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:49.405667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:49.544612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27366b4e0d1746a8a4aa96f7d8ff4061', 'request_id': 'req-7cfbb4f1-2beb-4164-b783-319561506c96'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.626453 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27366b4e0d1746a8a4aa96f7d8ff4061', 'request_id': 'req-7cfbb4f1-2beb-4164-b783-319561506c96'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.633910 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27366b4e0d1746a8a4aa96f7d8ff4061', 'request_id': 'req-7cfbb4f1-2beb-4164-b783-319561506c96'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.644377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] The token cache is being invalidate because project 27366b4e0d1746a8a4aa96f7d8ff4061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:27:49.644666 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.645299 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.647491 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1408/2816] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:27:49 2022] DELETE /identity/v3/projects/27366b4e0d1746a8a4aa96f7d8ff4061 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:27:49.651548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:49.652981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:49.665899 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdba59-9728-4d80-96f1-8107c066c3c4 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:49.700167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:27:49.722589 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:49.723461 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:49.723745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:49.724047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] PATH_INFO: `/v3/users/d1cf7577c9004a45a567ce724cf7a3e5` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:49.725265 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cf7577c9004a45a567ce724cf7a3e5)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:49.727216 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:49.900866 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cf7577c9004a45a567ce724cf7a3e5'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.907805 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cf7577c9004a45a567ce724cf7a3e5'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.994964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cf7577c9004a45a567ce724cf7a3e5'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:49.995580 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cf7577c9004a45a567ce724cf7a3e5'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:50.008795 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cf7577c9004a45a567ce724cf7a3e5'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:50.015276 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1409/2817] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:27:49 2022] DELETE /identity/v3/users/d1cf7577c9004a45a567ce724cf7a3e5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:27:50.277388 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:27:50.279022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:27:50.298411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb4f1-2beb-4164-b783-319561506c96 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:27:50.359350 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:27:50.360252 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:27:50.360535 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:27:50.360810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] PATH_INFO: `/v3/projects/4d0b108b2f574a53bd3beb1c38e8d865` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:27:50.362032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0b108b2f574a53bd3beb1c38e8d865)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:27:50.363987 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:27:50.370916 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:27:50.498057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0b108b2f574a53bd3beb1c38e8d865', 'request_id': 'req-5c073e47-d431-4c71-ac5a-6c3328c6333c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:50.572579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0b108b2f574a53bd3beb1c38e8d865', 'request_id': 'req-5c073e47-d431-4c71-ac5a-6c3328c6333c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:50.579286 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0b108b2f574a53bd3beb1c38e8d865', 'request_id': 'req-5c073e47-d431-4c71-ac5a-6c3328c6333c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:50.591118 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] The token cache is being invalidate because project 4d0b108b2f574a53bd3beb1c38e8d865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:27:50.591407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:50.592080 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:27:50.593611 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1409/2818] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:27:50 2022] DELETE /identity/v3/projects/4d0b108b2f574a53bd3beb1c38e8d865 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:28:00.011342 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:28:00.635450 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:28:04.115230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:04.116713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:04.211420 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7074cf-9170-4165-a89d-d9f113cb947f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:04.270941 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:04.271598 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:04.271931 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:04.272214 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:04.274004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:04.286210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:04.287850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:04.302253 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1410/2819] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:28:14.294345 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=67 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:28:45.207508 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:45.208936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:45.266610 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c073e47-d431-4c71-ac5a-6c3328c6333c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:45.270229 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:45.270862 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:45.271143 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:45.271414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:45.273188 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:45.334568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:45.336024 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:45.345459 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1410/2820] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:28:48.609848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:48.611391 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:48.625807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e95025-4087-4e36-9d71-22c04209f48a service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:48.632308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a5bde-c896-4391-83f8-ac4647d1f0a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:48.632962 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a5bde-c896-4391-83f8-ac4647d1f0a2 service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:48.633248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a5bde-c896-4391-83f8-ac4647d1f0a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:48.633529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a5bde-c896-4391-83f8-ac4647d1f0a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:48.635309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-700a5bde-c896-4391-83f8-ac4647d1f0a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:48.648004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a5bde-c896-4391-83f8-ac4647d1f0a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:48.649607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a5bde-c896-4391-83f8-ac4647d1f0a2 service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:48.660123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1411/2821] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:28:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:28:48.717115 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:48.719044 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:48.730979 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61777e5-1fd8-442a-a213-ed4bd621d51e service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:48.735584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:48.736493 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:48.736837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:48.737357 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] PATH_INFO: `/v3/users/e95a1f9496564c2783c228929fdbcb32` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:48.738650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95a1f9496564c2783c228929fdbcb32)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:48.740649 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:48.901597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95a1f9496564c2783c228929fdbcb32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:48.909870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95a1f9496564c2783c228929fdbcb32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:48.910607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95a1f9496564c2783c228929fdbcb32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:48.922745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95a1f9496564c2783c228929fdbcb32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:48.995820 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-771f95d1-ae47-480e-9faf-d4c6bb9f94dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95a1f9496564c2783c228929fdbcb32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:49.002025 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1411/2822] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:28:48 2022] DELETE /identity/v3/users/e95a1f9496564c2783c228929fdbcb32 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:28:49.259131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a5bde-c896-4391-83f8-ac4647d1f0a2 service placement] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:49.271355 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a5bde-c896-4391-83f8-ac4647d1f0a2 service placement] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:49.328887 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:49.329831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:49.330145 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:49.330458 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] PATH_INFO: `/v3/projects/bdd40a85f0284703ad395e91912991d7` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:49.331880 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd40a85f0284703ad395e91912991d7)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:49.333844 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:49.452249 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd40a85f0284703ad395e91912991d7', 'request_id': 'req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:49.458573 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd40a85f0284703ad395e91912991d7', 'request_id': 'req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:49.464007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd40a85f0284703ad395e91912991d7', 'request_id': 'req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:49.544123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] The token cache is being invalidate because project bdd40a85f0284703ad395e91912991d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:28:49.544433 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:49.545047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-1ce014dc-f67a-41fd-98d9-fbbb7d17dc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:28:49.546699 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1412/2823] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:28:49 2022] DELETE /identity/v3/projects/bdd40a85f0284703ad395e91912991d7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:28:49.552272 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4951993-530c-4746-b293-649be4d7c060 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:49.552564 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4951993-530c-4746-b293-649be4d7c060 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:49.552844 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4951993-530c-4746-b293-649be4d7c060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:49.584125 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:28:49.598019 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e4951993-530c-4746-b293-649be4d7c060 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:28:49.599214 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e4951993-530c-4746-b293-649be4d7c060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:49.656372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1412/2824] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:28:49.665352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5940cf3-de7d-46bf-804c-dc28cf0a4cc4 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:49.673255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5940cf3-de7d-46bf-804c-dc28cf0a4cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:49.673255 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5940cf3-de7d-46bf-804c-dc28cf0a4cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:49.684876 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-f5940cf3-de7d-46bf-804c-dc28cf0a4cc4 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:28:49.686131 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-f5940cf3-de7d-46bf-804c-dc28cf0a4cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:49.694149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1413/2825] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:28:49.698499 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4951993-530c-4746-b293-649be4d7c060 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:49.709194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4951993-530c-4746-b293-649be4d7c060 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:49.713853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18320ce-3288-42da-a4db-3cad13c81f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:49.714536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18320ce-3288-42da-a4db-3cad13c81f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:49.714823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18320ce-3288-42da-a4db-3cad13c81f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:49.715103 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18320ce-3288-42da-a4db-3cad13c81f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:49.715836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18320ce-3288-42da-a4db-3cad13c81f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:28:49.716178 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18320ce-3288-42da-a4db-3cad13c81f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:49.717802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18320ce-3288-42da-a4db-3cad13c81f4a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:49.730674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1413/2826] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:28:49.734848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5940cf3-de7d-46bf-804c-dc28cf0a4cc4 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:49.744198 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5940cf3-de7d-46bf-804c-dc28cf0a4cc4 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:49.748845 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8868ec-7a42-407f-ac62-d2b11e96a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:49.749487 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8868ec-7a42-407f-ac62-d2b11e96a551 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:49.749767 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8868ec-7a42-407f-ac62-d2b11e96a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:49.750039 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8868ec-7a42-407f-ac62-d2b11e96a551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:49.750730 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8868ec-7a42-407f-ac62-d2b11e96a551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:49.752690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8868ec-7a42-407f-ac62-d2b11e96a551 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:49.832001 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1414/2827] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:28:49 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:28:49.836242 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18320ce-3288-42da-a4db-3cad13c81f4a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:49.846966 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18320ce-3288-42da-a4db-3cad13c81f4a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:49.901995 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb32e67-6edc-435c-98fd-46fe60c80141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:49.902652 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb32e67-6edc-435c-98fd-46fe60c80141 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:49.902937 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb32e67-6edc-435c-98fd-46fe60c80141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:49.903212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb32e67-6edc-435c-98fd-46fe60c80141 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:49.903936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb32e67-6edc-435c-98fd-46fe60c80141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:49.905836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb32e67-6edc-435c-98fd-46fe60c80141 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:50.013829 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1414/2828] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:28:49 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:28:50.017889 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8868ec-7a42-407f-ac62-d2b11e96a551 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:50.028910 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8868ec-7a42-407f-ac62-d2b11e96a551 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:50.033534 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cc371-d616-488f-abc8-b516231fb78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:50.034969 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc371-d616-488f-abc8-b516231fb78f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:50.035256 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc371-d616-488f-abc8-b516231fb78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:50.035535 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc371-d616-488f-abc8-b516231fb78f admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:50.036297 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cc371-d616-488f-abc8-b516231fb78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:50.037886 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cc371-d616-488f-abc8-b516231fb78f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:50.048382 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1415/2829] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:28:50.052612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb32e67-6edc-435c-98fd-46fe60c80141 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:50.062819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb32e67-6edc-435c-98fd-46fe60c80141 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:50.068165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6617e82-fb8e-438a-b531-58f369625edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:50.068826 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6617e82-fb8e-438a-b531-58f369625edc admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:50.069111 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6617e82-fb8e-438a-b531-58f369625edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:50.069396 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6617e82-fb8e-438a-b531-58f369625edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:50.070129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6617e82-fb8e-438a-b531-58f369625edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:50.071712 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6617e82-fb8e-438a-b531-58f369625edc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:50.082753 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1415/2830] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:28:50.086808 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cc371-d616-488f-abc8-b516231fb78f admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:50.097747 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cc371-d616-488f-abc8-b516231fb78f admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:50.102657 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13493bbd-bd39-4294-b30a-005c4840a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:50.103591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13493bbd-bd39-4294-b30a-005c4840a179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:50.103915 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13493bbd-bd39-4294-b30a-005c4840a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:50.104176 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13493bbd-bd39-4294-b30a-005c4840a179 admin admin] PATH_INFO: `/v3/projects/056c3d7e1f844f499b0322bc30a197d3/users/98f8a44f23604c85b9a2c016c06a6f52/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:50.120056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13493bbd-bd39-4294-b30a-005c4840a179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056c3d7e1f844f499b0322bc30a197d3, user_id=98f8a44f23604c85b9a2c016c06a6f52, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:50.122726 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13493bbd-bd39-4294-b30a-005c4840a179 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:50.208414 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1416/2831] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:28:50 2022] PUT /identity/v3/projects/056c3d7e1f844f499b0322bc30a197d3/users/98f8a44f23604c85b9a2c016c06a6f52/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:28:50.218400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c209-d26f-4b77-95ff-8e20ff06d169 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:50.218689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c209-d26f-4b77-95ff-8e20ff06d169 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:50.218962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c209-d26f-4b77-95ff-8e20ff06d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:50.245419 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-afb2c209-d26f-4b77-95ff-8e20ff06d169 None None] MFA Rules not processed for user `98f8a44f23604c85b9a2c016c06a6f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:28:50.246620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-afb2c209-d26f-4b77-95ff-8e20ff06d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:50.302327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:28:50.311090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1416/2832] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:28:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 12:28:50.322707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13493bbd-bd39-4294-b30a-005c4840a179 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:28:50.324548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-13493bbd-bd39-4294-b30a-005c4840a179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:28:50.343443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:28:50.403140 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13493bbd-bd39-4294-b30a-005c4840a179 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:28:50.406831 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f3ccf-3147-4389-a0db-a76e816a6580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:28:50.407476 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3ccf-3147-4389-a0db-a76e816a6580 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:28:50.407760 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3ccf-3147-4389-a0db-a76e816a6580 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:28:50.408132 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3ccf-3147-4389-a0db-a76e816a6580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:28:50.416818 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f3ccf-3147-4389-a0db-a76e816a6580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:28:50.418344 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f3ccf-3147-4389-a0db-a76e816a6580 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:28:50.427366 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1417/2833] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:28:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:00.140011 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2c209-d26f-4b77-95ff-8e20ff06d169 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:00.203204 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2c209-d26f-4b77-95ff-8e20ff06d169 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:00.207936 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:00.208850 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:00.209134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:00.209464 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] PATH_INFO: `/v3/users/98f8a44f23604c85b9a2c016c06a6f52` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:00.210851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f8a44f23604c85b9a2c016c06a6f52)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:00.213001 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:00.397828 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f8a44f23604c85b9a2c016c06a6f52'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:00.405445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f8a44f23604c85b9a2c016c06a6f52'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:00.406108 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f8a44f23604c85b9a2c016c06a6f52'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:00.418674 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f8a44f23604c85b9a2c016c06a6f52'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:00.470091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=29 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:00.475187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f8a44f23604c85b9a2c016c06a6f52'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:00.481405 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1417/2834] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:29:00 2022] DELETE /identity/v3/users/98f8a44f23604c85b9a2c016c06a6f52 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:00.485839 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404821b-d0a9-40eb-aa1a-c314ef9fa891 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:00.486161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404821b-d0a9-40eb-aa1a-c314ef9fa891 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:00.486443 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404821b-d0a9-40eb-aa1a-c314ef9fa891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:00.503739 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-a404821b-d0a9-40eb-aa1a-c314ef9fa891 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:00.504974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a404821b-d0a9-40eb-aa1a-c314ef9fa891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:00.564944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1418/2835] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:00.574912 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:00.576369 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:00.633303 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c38a-0256-48ce-8bd7-db6cfc196905 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:00.637065 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec201a55-2bc7-459d-b24e-80fa9aa4dab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:00.637709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec201a55-2bc7-459d-b24e-80fa9aa4dab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:00.637994 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec201a55-2bc7-459d-b24e-80fa9aa4dab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:00.638271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec201a55-2bc7-459d-b24e-80fa9aa4dab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:00.647411 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec201a55-2bc7-459d-b24e-80fa9aa4dab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:00.649537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec201a55-2bc7-459d-b24e-80fa9aa4dab1 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:00.658956 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1418/2836] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:01.037024 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404821b-d0a9-40eb-aa1a-c314ef9fa891 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:01.038482 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-a404821b-d0a9-40eb-aa1a-c314ef9fa891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:01.054004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404821b-d0a9-40eb-aa1a-c314ef9fa891 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:01.060610 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:01.061502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.061789 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.062070 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] PATH_INFO: `/v3/projects/056c3d7e1f844f499b0322bc30a197d3` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.063351 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=056c3d7e1f844f499b0322bc30a197d3)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:01.065390 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:01.172692 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056c3d7e1f844f499b0322bc30a197d3', 'request_id': 'req-e42bf07b-6ee0-4794-84b4-cc025f91cab6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:01.178704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056c3d7e1f844f499b0322bc30a197d3', 'request_id': 'req-e42bf07b-6ee0-4794-84b4-cc025f91cab6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:01.185020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056c3d7e1f844f499b0322bc30a197d3', 'request_id': 'req-e42bf07b-6ee0-4794-84b4-cc025f91cab6'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:01.280117 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] The token cache is being invalidate because project 056c3d7e1f844f499b0322bc30a197d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:29:01.280403 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:01.281035 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e42bf07b-6ee0-4794-84b4-cc025f91cab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:01.282644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1419/2837] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:29:01 2022] DELETE /identity/v3/projects/056c3d7e1f844f499b0322bc30a197d3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:01.287498 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef5102-5ab6-42e1-a7db-c2f7e42871db None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.291341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef5102-5ab6-42e1-a7db-c2f7e42871db None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.291341 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef5102-5ab6-42e1-a7db-c2f7e42871db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.306815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a6ef5102-5ab6-42e1-a7db-c2f7e42871db None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:01.308078 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a6ef5102-5ab6-42e1-a7db-c2f7e42871db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:01.319992 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:01.369324 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1419/2838] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:01.376896 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bda9df-b6a5-4a2c-beaa-55e31658757f None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.377184 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bda9df-b6a5-4a2c-beaa-55e31658757f None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.377460 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bda9df-b6a5-4a2c-beaa-55e31658757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.395971 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-87bda9df-b6a5-4a2c-beaa-55e31658757f None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:01.397158 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-87bda9df-b6a5-4a2c-beaa-55e31658757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:01.405494 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1420/2839] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:01.409601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef5102-5ab6-42e1-a7db-c2f7e42871db None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:01.419845 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef5102-5ab6-42e1-a7db-c2f7e42871db None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:01.424440 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33732d5-b76e-4a7e-ad7d-ca5289fd95f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:01.425028 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33732d5-b76e-4a7e-ad7d-ca5289fd95f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.425310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33732d5-b76e-4a7e-ad7d-ca5289fd95f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.425584 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33732d5-b76e-4a7e-ad7d-ca5289fd95f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.426308 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33732d5-b76e-4a7e-ad7d-ca5289fd95f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:29:01.426614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33732d5-b76e-4a7e-ad7d-ca5289fd95f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:01.428226 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33732d5-b76e-4a7e-ad7d-ca5289fd95f9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:01.440238 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1420/2840] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:29:01.444257 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bda9df-b6a5-4a2c-beaa-55e31658757f None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:01.453507 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bda9df-b6a5-4a2c-beaa-55e31658757f None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:01.458084 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde92891-94fb-4889-a367-b7e12937510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:01.458723 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde92891-94fb-4889-a367-b7e12937510a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.459002 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde92891-94fb-4889-a367-b7e12937510a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.459274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde92891-94fb-4889-a367-b7e12937510a admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.459989 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde92891-94fb-4889-a367-b7e12937510a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:01.462311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde92891-94fb-4889-a367-b7e12937510a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:01.525240 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1421/2841] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:29:01 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:01.526362 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33732d5-b76e-4a7e-ad7d-ca5289fd95f9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:01.536270 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33732d5-b76e-4a7e-ad7d-ca5289fd95f9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:01.594164 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490dab41-9dc1-45da-a293-443fd3679200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:01.594819 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dab41-9dc1-45da-a293-443fd3679200 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.595100 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dab41-9dc1-45da-a293-443fd3679200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.595372 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dab41-9dc1-45da-a293-443fd3679200 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.596093 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490dab41-9dc1-45da-a293-443fd3679200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:01.597985 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490dab41-9dc1-45da-a293-443fd3679200 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:01.685370 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1421/2842] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:29:01 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:29:01.689379 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde92891-94fb-4889-a367-b7e12937510a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:01.699527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde92891-94fb-4889-a367-b7e12937510a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:01.704153 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cca91-886e-47f2-b581-e49e6de3ca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:01.704796 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cca91-886e-47f2-b581-e49e6de3ca6e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.705077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cca91-886e-47f2-b581-e49e6de3ca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.705350 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cca91-886e-47f2-b581-e49e6de3ca6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.706068 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cca91-886e-47f2-b581-e49e6de3ca6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:01.707762 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cca91-886e-47f2-b581-e49e6de3ca6e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:01.718526 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1422/2843] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:01.722295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490dab41-9dc1-45da-a293-443fd3679200 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:01.732684 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490dab41-9dc1-45da-a293-443fd3679200 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:01.737283 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d565a-4b49-4701-a9dd-78a1977b837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:01.737930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d565a-4b49-4701-a9dd-78a1977b837c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.738212 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d565a-4b49-4701-a9dd-78a1977b837c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.738488 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d565a-4b49-4701-a9dd-78a1977b837c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.739205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d565a-4b49-4701-a9dd-78a1977b837c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:01.740802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d565a-4b49-4701-a9dd-78a1977b837c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:01.750399 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1422/2844] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:01.754309 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cca91-886e-47f2-b581-e49e6de3ca6e admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:01.764591 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cca91-886e-47f2-b581-e49e6de3ca6e admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:01.769262 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bb3b5-677e-4e0b-9de9-09cce7359513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:01.770141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb3b5-677e-4e0b-9de9-09cce7359513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.770426 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb3b5-677e-4e0b-9de9-09cce7359513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.770704 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb3b5-677e-4e0b-9de9-09cce7359513 admin admin] PATH_INFO: `/v3/projects/e0f8eac6911e4ff9a12607f92214ffb4/users/25bdd905680d4fb79230a0c1c2ec65db/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.785670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bb3b5-677e-4e0b-9de9-09cce7359513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f8eac6911e4ff9a12607f92214ffb4, user_id=25bdd905680d4fb79230a0c1c2ec65db, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:01.788383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bb3b5-677e-4e0b-9de9-09cce7359513 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:01.926417 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1423/2845] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:01 2022] PUT /identity/v3/projects/e0f8eac6911e4ff9a12607f92214ffb4/users/25bdd905680d4fb79230a0c1c2ec65db/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:01.943443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ec1fe-8e37-411c-a1b9-507ff069acba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:01.943665 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ec1fe-8e37-411c-a1b9-507ff069acba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:01.943970 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ec1fe-8e37-411c-a1b9-507ff069acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:01.970156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fe6ec1fe-8e37-411c-a1b9-507ff069acba None None] MFA Rules not processed for user `25bdd905680d4fb79230a0c1c2ec65db`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:01.971363 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe6ec1fe-8e37-411c-a1b9-507ff069acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:02.034398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1423/2846] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:02.039659 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bb3b5-677e-4e0b-9de9-09cce7359513 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:02.060705 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:02.099361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bb3b5-677e-4e0b-9de9-09cce7359513 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:02.105122 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f553ac3-9ac2-4087-8ae1-3c20aa7e2264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:02.105775 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f553ac3-9ac2-4087-8ae1-3c20aa7e2264 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:02.106055 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f553ac3-9ac2-4087-8ae1-3c20aa7e2264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:02.106326 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f553ac3-9ac2-4087-8ae1-3c20aa7e2264 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:02.107015 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f553ac3-9ac2-4087-8ae1-3c20aa7e2264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:02.108949 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f553ac3-9ac2-4087-8ae1-3c20aa7e2264 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:02.207753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1424/2847] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:29:02 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:02.211842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ec1fe-8e37-411c-a1b9-507ff069acba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:02.222594 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ec1fe-8e37-411c-a1b9-507ff069acba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:02.231893 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:02.280596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0c115-a891-4b2b-b659-b337fa62878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:02.281261 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0c115-a891-4b2b-b659-b337fa62878f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:02.281542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0c115-a891-4b2b-b659-b337fa62878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:02.281812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0c115-a891-4b2b-b659-b337fa62878f admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:02.282506 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0c115-a891-4b2b-b659-b337fa62878f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:02.284448 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0c115-a891-4b2b-b659-b337fa62878f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:02.349165 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1424/2848] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:29:02 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:02.353670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f553ac3-9ac2-4087-8ae1-3c20aa7e2264 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:02.364026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f553ac3-9ac2-4087-8ae1-3c20aa7e2264 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:02.369056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482ee26-b47c-4bb2-9b5b-fe2373a178a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:02.369707 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482ee26-b47c-4bb2-9b5b-fe2373a178a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:02.370007 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482ee26-b47c-4bb2-9b5b-fe2373a178a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:02.370273 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482ee26-b47c-4bb2-9b5b-fe2373a178a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:02.371040 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482ee26-b47c-4bb2-9b5b-fe2373a178a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:02.372678 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482ee26-b47c-4bb2-9b5b-fe2373a178a2 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:02.383306 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1425/2849] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:02.387377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0c115-a891-4b2b-b659-b337fa62878f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:02.397492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0c115-a891-4b2b-b659-b337fa62878f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:02.402921 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db598-a4e2-4c1a-a844-195849c71d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:02.403802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db598-a4e2-4c1a-a844-195849c71d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:02.404323 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db598-a4e2-4c1a-a844-195849c71d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:02.404608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db598-a4e2-4c1a-a844-195849c71d2c admin admin] PATH_INFO: `/v3/projects/824c4e5df37c45099dd7d20012d1453e/users/012578ee3e0541f8a781ed3f8a38976a/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:02.420253 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5db598-a4e2-4c1a-a844-195849c71d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=824c4e5df37c45099dd7d20012d1453e, user_id=012578ee3e0541f8a781ed3f8a38976a, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:02.422875 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5db598-a4e2-4c1a-a844-195849c71d2c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:02.496473 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1425/2850] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:02 2022] PUT /identity/v3/projects/824c4e5df37c45099dd7d20012d1453e/users/012578ee3e0541f8a781ed3f8a38976a/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:02.500284 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482ee26-b47c-4bb2-9b5b-fe2373a178a2 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:02.510599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482ee26-b47c-4bb2-9b5b-fe2373a178a2 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:02.566811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1caef8-88a0-48a5-afd7-1d8f356b831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:02.567468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1caef8-88a0-48a5-afd7-1d8f356b831f admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:02.567749 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1caef8-88a0-48a5-afd7-1d8f356b831f admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:02.568058 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1caef8-88a0-48a5-afd7-1d8f356b831f admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:02.568779 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1caef8-88a0-48a5-afd7-1d8f356b831f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:02.570361 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1caef8-88a0-48a5-afd7-1d8f356b831f admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:02.579797 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1426/2851] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:02.583947 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db598-a4e2-4c1a-a844-195849c71d2c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:02.594877 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db598-a4e2-4c1a-a844-195849c71d2c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:02.599612 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3f94-f6c6-4ec3-947c-642f8171206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:02.600537 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3f94-f6c6-4ec3-947c-642f8171206b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:02.600824 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3f94-f6c6-4ec3-947c-642f8171206b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:02.601187 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3f94-f6c6-4ec3-947c-642f8171206b admin admin] PATH_INFO: `/v3/projects/824c4e5df37c45099dd7d20012d1453e/users/012578ee3e0541f8a781ed3f8a38976a/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:02.603853 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e3f94-f6c6-4ec3-947c-642f8171206b admin admin] RBAC: Authorizing `identity:create_grant(project_id=824c4e5df37c45099dd7d20012d1453e, user_id=012578ee3e0541f8a781ed3f8a38976a, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:02.606516 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e3f94-f6c6-4ec3-947c-642f8171206b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:02.616680 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1426/2852] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:02 2022] PUT /identity/v3/projects/824c4e5df37c45099dd7d20012d1453e/users/012578ee3e0541f8a781ed3f8a38976a/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:02.626616 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb598-f249-48d6-a245-0acf9adb2cc1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:02.626901 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb598-f249-48d6-a245-0acf9adb2cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:02.627224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb598-f249-48d6-a245-0acf9adb2cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:02.654026 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-4aceb598-f249-48d6-a245-0acf9adb2cc1 None None] MFA Rules not processed for user `012578ee3e0541f8a781ed3f8a38976a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:02.655267 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-4aceb598-f249-48d6-a245-0acf9adb2cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:02.724013 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1427/2853] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:02.735608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3f94-f6c6-4ec3-947c-642f8171206b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:02.737310 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-452e3f94-f6c6-4ec3-947c-642f8171206b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:02.793623 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3f94-f6c6-4ec3-947c-642f8171206b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:02.797094 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cfaef-62ee-4f96-8016-e4ade73a5a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:02.797727 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cfaef-62ee-4f96-8016-e4ade73a5a5c service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:02.798008 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cfaef-62ee-4f96-8016-e4ade73a5a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:02.798285 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cfaef-62ee-4f96-8016-e4ade73a5a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:02.807060 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cfaef-62ee-4f96-8016-e4ade73a5a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:02.808524 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cfaef-62ee-4f96-8016-e4ade73a5a5c service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:02.817704 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1427/2854] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:03.037315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb598-f249-48d6-a245-0acf9adb2cc1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:03.048064 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb598-f249-48d6-a245-0acf9adb2cc1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:03.051690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f44be-cc26-48f3-b198-51dbe7b184ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:03.052384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f44be-cc26-48f3-b198-51dbe7b184ac service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:03.055453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f44be-cc26-48f3-b198-51dbe7b184ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:03.055453 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f44be-cc26-48f3-b198-51dbe7b184ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:03.066438 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:03.112141 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f44be-cc26-48f3-b198-51dbe7b184ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:03.113596 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f44be-cc26-48f3-b198-51dbe7b184ac service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:03.123935 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1428/2855] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:12.813696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=64,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:13.143665 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=21 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:39.762309 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cfaef-62ee-4f96-8016-e4ade73a5a5c service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:39.824402 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cfaef-62ee-4f96-8016-e4ade73a5a5c service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:39.829560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:39.830437 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:39.830726 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:39.831006 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] PATH_INFO: `/v3/users/25bdd905680d4fb79230a0c1c2ec65db` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:39.832235 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bdd905680d4fb79230a0c1c2ec65db)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:39.834156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:40.001830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bdd905680d4fb79230a0c1c2ec65db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.008595 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bdd905680d4fb79230a0c1c2ec65db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.009263 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bdd905680d4fb79230a0c1c2ec65db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.022429 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bdd905680d4fb79230a0c1c2ec65db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.125200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bdd905680d4fb79230a0c1c2ec65db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.132759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1428/2856] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:29:39 2022] DELETE /identity/v3/users/25bdd905680d4fb79230a0c1c2ec65db => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:40.137061 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c61c-6b02-4ff2-a320-718e298781e1 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:40.137557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c61c-6b02-4ff2-a320-718e298781e1 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:40.137661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c61c-6b02-4ff2-a320-718e298781e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:40.155371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c217c61c-6b02-4ff2-a320-718e298781e1 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:40.156651 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c217c61c-6b02-4ff2-a320-718e298781e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:40.217411 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1429/2857] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:40.227213 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:40.228699 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:40.289668 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbce314-06ce-4121-862b-6504a00fadf0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:40.293830 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691cb00-7720-4d5f-8568-5adaca88aa6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:40.298696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691cb00-7720-4d5f-8568-5adaca88aa6f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:40.298696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691cb00-7720-4d5f-8568-5adaca88aa6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:40.298696 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691cb00-7720-4d5f-8568-5adaca88aa6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:40.304404 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691cb00-7720-4d5f-8568-5adaca88aa6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:40.305834 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691cb00-7720-4d5f-8568-5adaca88aa6f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:40.315380 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1429/2858] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:40.721402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217c61c-6b02-4ff2-a320-718e298781e1 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:40.722917 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c217c61c-6b02-4ff2-a320-718e298781e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:40.735463 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217c61c-6b02-4ff2-a320-718e298781e1 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:40.740456 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:40.741400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:40.741676 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:40.741945 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] PATH_INFO: `/v3/projects/e0f8eac6911e4ff9a12607f92214ffb4` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:40.743137 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f8eac6911e4ff9a12607f92214ffb4)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:40.745188 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:40.862477 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f8eac6911e4ff9a12607f92214ffb4', 'request_id': 'req-363f1175-9e78-406a-bd0a-1384d0ede040'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.868564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f8eac6911e4ff9a12607f92214ffb4', 'request_id': 'req-363f1175-9e78-406a-bd0a-1384d0ede040'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.874918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f8eac6911e4ff9a12607f92214ffb4', 'request_id': 'req-363f1175-9e78-406a-bd0a-1384d0ede040'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.947019 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] The token cache is being invalidate because project e0f8eac6911e4ff9a12607f92214ffb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:29:40.947300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.947938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:40.949585 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1430/2859] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:29:40 2022] DELETE /identity/v3/projects/e0f8eac6911e4ff9a12607f92214ffb4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:40.953658 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691cb00-7720-4d5f-8568-5adaca88aa6f service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:40.963476 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691cb00-7720-4d5f-8568-5adaca88aa6f service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:40.982052 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:41.019981 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:41.020856 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:41.021140 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:41.021414 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] PATH_INFO: `/v3/users/012578ee3e0541f8a781ed3f8a38976a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:41.022607 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=012578ee3e0541f8a781ed3f8a38976a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:41.024548 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:41.156417 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '012578ee3e0541f8a781ed3f8a38976a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.163558 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '012578ee3e0541f8a781ed3f8a38976a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.164234 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '012578ee3e0541f8a781ed3f8a38976a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.176048 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '012578ee3e0541f8a781ed3f8a38976a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.250407 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-44b3a12c-47e2-485c-aa54-a2e454cf1b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '012578ee3e0541f8a781ed3f8a38976a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.256560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1430/2860] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:29:40 2022] DELETE /identity/v3/users/012578ee3e0541f8a781ed3f8a38976a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:41.675911 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:41.677400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:41.691942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f1175-9e78-406a-bd0a-1384d0ede040 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:41.750230 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:41.751090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:41.751397 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:41.751698 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] PATH_INFO: `/v3/projects/824c4e5df37c45099dd7d20012d1453e` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:41.752936 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824c4e5df37c45099dd7d20012d1453e)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:41.754828 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:41.846491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:41.863161 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824c4e5df37c45099dd7d20012d1453e', 'request_id': 'req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.869248 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824c4e5df37c45099dd7d20012d1453e', 'request_id': 'req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.875308 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824c4e5df37c45099dd7d20012d1453e', 'request_id': 'req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.970632 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] The token cache is being invalidate because project 824c4e5df37c45099dd7d20012d1453e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80314) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:29:41.970850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.971506 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-158e6eaf-14ce-4d4d-b1f9-1a99c3efb656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:41.973114 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1431/2861] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:29:41 2022] DELETE /identity/v3/projects/824c4e5df37c45099dd7d20012d1453e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:41.978250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bcb18-f93c-4505-a3bc-fb596851e442 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:41.978734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bcb18-f93c-4505-a3bc-fb596851e442 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:41.978837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bcb18-f93c-4505-a3bc-fb596851e442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:41.999023 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e87bcb18-f93c-4505-a3bc-fb596851e442 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:42.003667 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e87bcb18-f93c-4505-a3bc-fb596851e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:42.057959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1431/2862] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:42.066048 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826edc9-b614-4857-91bf-a389aaaf065d None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.066338 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826edc9-b614-4857-91bf-a389aaaf065d None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.066613 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826edc9-b614-4857-91bf-a389aaaf065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.084442 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-3826edc9-b614-4857-91bf-a389aaaf065d None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:42.085629 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-3826edc9-b614-4857-91bf-a389aaaf065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:42.094149 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1432/2863] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:42.098197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bcb18-f93c-4505-a3bc-fb596851e442 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:42.108672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bcb18-f93c-4505-a3bc-fb596851e442 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:42.113205 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db1d4b-6028-442d-b7ef-87b845cf453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:42.113847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db1d4b-6028-442d-b7ef-87b845cf453f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.114127 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db1d4b-6028-442d-b7ef-87b845cf453f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.114398 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db1d4b-6028-442d-b7ef-87b845cf453f admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.115123 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db1d4b-6028-442d-b7ef-87b845cf453f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:29:42.115431 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db1d4b-6028-442d-b7ef-87b845cf453f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:42.117042 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db1d4b-6028-442d-b7ef-87b845cf453f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:42.128403 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1432/2864] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:29:42.132607 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826edc9-b614-4857-91bf-a389aaaf065d None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:42.141933 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826edc9-b614-4857-91bf-a389aaaf065d None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:42.146491 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf174c6-ce8e-4c30-8701-737fa8d98bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:42.147129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf174c6-ce8e-4c30-8701-737fa8d98bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.147409 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf174c6-ce8e-4c30-8701-737fa8d98bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.147685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf174c6-ce8e-4c30-8701-737fa8d98bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.148400 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf174c6-ce8e-4c30-8701-737fa8d98bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:42.150286 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf174c6-ce8e-4c30-8701-737fa8d98bc0 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:42.257862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1433/2865] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:29:42 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:42.261870 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db1d4b-6028-442d-b7ef-87b845cf453f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:42.272375 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db1d4b-6028-442d-b7ef-87b845cf453f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:42.298721 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:42.328962 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9442104-bfb0-4685-8011-d2cf37a83389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:42.329679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9442104-bfb0-4685-8011-d2cf37a83389 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.329969 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9442104-bfb0-4685-8011-d2cf37a83389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.330513 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9442104-bfb0-4685-8011-d2cf37a83389 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.331259 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9442104-bfb0-4685-8011-d2cf37a83389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:42.333806 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9442104-bfb0-4685-8011-d2cf37a83389 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:42.439507 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1433/2866] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:29:42 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:42.443571 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf174c6-ce8e-4c30-8701-737fa8d98bc0 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:42.454748 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf174c6-ce8e-4c30-8701-737fa8d98bc0 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:42.459513 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6104e81-4123-4a6b-8782-b96117f4d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:42.460206 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6104e81-4123-4a6b-8782-b96117f4d996 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.460492 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6104e81-4123-4a6b-8782-b96117f4d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.460770 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6104e81-4123-4a6b-8782-b96117f4d996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.461523 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6104e81-4123-4a6b-8782-b96117f4d996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:42.463116 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6104e81-4123-4a6b-8782-b96117f4d996 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:42.474126 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1434/2867] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:42.477905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9442104-bfb0-4685-8011-d2cf37a83389 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:42.487578 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9442104-bfb0-4685-8011-d2cf37a83389 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:42.492240 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a445aa-ba24-4543-b8a9-13756e33d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:42.492885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a445aa-ba24-4543-b8a9-13756e33d59f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.493167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a445aa-ba24-4543-b8a9-13756e33d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.493445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a445aa-ba24-4543-b8a9-13756e33d59f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.494167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a445aa-ba24-4543-b8a9-13756e33d59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:42.495740 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a445aa-ba24-4543-b8a9-13756e33d59f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:42.505427 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1434/2868] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:42.509690 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6104e81-4123-4a6b-8782-b96117f4d996 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:42.520340 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6104e81-4123-4a6b-8782-b96117f4d996 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:42.524995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f461043-76f7-455f-bb1f-288a5947654c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:42.525878 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f461043-76f7-455f-bb1f-288a5947654c admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.526144 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f461043-76f7-455f-bb1f-288a5947654c admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.526421 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f461043-76f7-455f-bb1f-288a5947654c admin admin] PATH_INFO: `/v3/projects/a9993322ec17423d8fbe57c9277e3f30/users/e159e1b807d64b43bef4768f4a77f3ab/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.542082 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f461043-76f7-455f-bb1f-288a5947654c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9993322ec17423d8fbe57c9277e3f30, user_id=e159e1b807d64b43bef4768f4a77f3ab, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:42.545258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f461043-76f7-455f-bb1f-288a5947654c admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:42.646004 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1435/2869] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:42 2022] PUT /identity/v3/projects/a9993322ec17423d8fbe57c9277e3f30/users/e159e1b807d64b43bef4768f4a77f3ab/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:42.657221 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3671e-c038-417b-81f2-29f91f4aead2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.657504 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3671e-c038-417b-81f2-29f91f4aead2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.657805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3671e-c038-417b-81f2-29f91f4aead2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.683734 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5fa3671e-c038-417b-81f2-29f91f4aead2 None None] MFA Rules not processed for user `e159e1b807d64b43bef4768f4a77f3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:42.685823 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5fa3671e-c038-417b-81f2-29f91f4aead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:42.750608 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1435/2870] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:42.755074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f461043-76f7-455f-bb1f-288a5947654c admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:42.816875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f461043-76f7-455f-bb1f-288a5947654c admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:42.821395 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf55fa3-0ce5-409c-8b80-b7502733a162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:42.822043 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf55fa3-0ce5-409c-8b80-b7502733a162 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.822328 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf55fa3-0ce5-409c-8b80-b7502733a162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.822602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf55fa3-0ce5-409c-8b80-b7502733a162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.823283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf55fa3-0ce5-409c-8b80-b7502733a162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:42.825892 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf55fa3-0ce5-409c-8b80-b7502733a162 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:42.921013 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1436/2871] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:29:42 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:42.925200 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3671e-c038-417b-81f2-29f91f4aead2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:42.936469 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3671e-c038-417b-81f2-29f91f4aead2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:42.991174 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802cdd8-0afa-4fd7-9092-03e684a323aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:42.991908 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802cdd8-0afa-4fd7-9092-03e684a323aa admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:42.992138 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802cdd8-0afa-4fd7-9092-03e684a323aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:42.992416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802cdd8-0afa-4fd7-9092-03e684a323aa admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:42.993167 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802cdd8-0afa-4fd7-9092-03e684a323aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:42.995046 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802cdd8-0afa-4fd7-9092-03e684a323aa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:43.067960 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1436/2872] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:29:42 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:43.071890 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf55fa3-0ce5-409c-8b80-b7502733a162 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:43.082349 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf55fa3-0ce5-409c-8b80-b7502733a162 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:43.087202 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e958c85-6541-4e47-a176-4b34fb560354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:43.087753 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e958c85-6541-4e47-a176-4b34fb560354 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:43.088081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e958c85-6541-4e47-a176-4b34fb560354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:43.088364 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e958c85-6541-4e47-a176-4b34fb560354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:43.089096 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e958c85-6541-4e47-a176-4b34fb560354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:43.090696 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e958c85-6541-4e47-a176-4b34fb560354 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:43.102167 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1437/2873] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:43.106883 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802cdd8-0afa-4fd7-9092-03e684a323aa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:43.117271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802cdd8-0afa-4fd7-9092-03e684a323aa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:43.122010 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b7733-c139-4290-8b78-797585e3004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:43.123634 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b7733-c139-4290-8b78-797585e3004c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:43.123930 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b7733-c139-4290-8b78-797585e3004c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:43.124215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b7733-c139-4290-8b78-797585e3004c admin admin] PATH_INFO: `/v3/projects/c657798020b8484d9444d112118d7728/users/6c32c9e9ab49466fae8bfeace0bf8a8a/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:43.138791 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b7733-c139-4290-8b78-797585e3004c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c657798020b8484d9444d112118d7728, user_id=6c32c9e9ab49466fae8bfeace0bf8a8a, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:43.141471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b7733-c139-4290-8b78-797585e3004c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:43.216255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1437/2874] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:43 2022] PUT /identity/v3/projects/c657798020b8484d9444d112118d7728/users/6c32c9e9ab49466fae8bfeace0bf8a8a/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:43.220123 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e958c85-6541-4e47-a176-4b34fb560354 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:43.230098 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e958c85-6541-4e47-a176-4b34fb560354 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:43.251329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:43.287057 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae886b-2566-419a-bba4-d2b5cef0b160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:43.287714 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae886b-2566-419a-bba4-d2b5cef0b160 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:43.288283 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae886b-2566-419a-bba4-d2b5cef0b160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:43.288557 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae886b-2566-419a-bba4-d2b5cef0b160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:43.289281 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae886b-2566-419a-bba4-d2b5cef0b160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:43.290868 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae886b-2566-419a-bba4-d2b5cef0b160 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:43.301274 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1438/2875] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:43.305107 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b7733-c139-4290-8b78-797585e3004c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:43.311443 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:43.317041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b7733-c139-4290-8b78-797585e3004c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:43.321825 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80e011-4986-466c-b05f-e304e9b05010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:43.322651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80e011-4986-466c-b05f-e304e9b05010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:43.322939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80e011-4986-466c-b05f-e304e9b05010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:43.323219 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80e011-4986-466c-b05f-e304e9b05010 admin admin] PATH_INFO: `/v3/projects/c657798020b8484d9444d112118d7728/users/6c32c9e9ab49466fae8bfeace0bf8a8a/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:43.325441 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80e011-4986-466c-b05f-e304e9b05010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c657798020b8484d9444d112118d7728, user_id=6c32c9e9ab49466fae8bfeace0bf8a8a, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:43.328129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80e011-4986-466c-b05f-e304e9b05010 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:43.338546 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1438/2876] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:43 2022] PUT /identity/v3/projects/c657798020b8484d9444d112118d7728/users/6c32c9e9ab49466fae8bfeace0bf8a8a/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 12:29:43.349643 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1304e83-fc35-449f-91b5-9eb13cf3db96 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:43.349932 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1304e83-fc35-449f-91b5-9eb13cf3db96 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:43.353783 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1304e83-fc35-449f-91b5-9eb13cf3db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:43.378959 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-c1304e83-fc35-449f-91b5-9eb13cf3db96 None None] MFA Rules not processed for user `6c32c9e9ab49466fae8bfeace0bf8a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:43.380200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-c1304e83-fc35-449f-91b5-9eb13cf3db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:43.449354 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1439/2877] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:43.460568 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80e011-4986-466c-b05f-e304e9b05010 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:43.462275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ce80e011-4986-466c-b05f-e304e9b05010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:43.519701 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80e011-4986-466c-b05f-e304e9b05010 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:43.523439 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad34ba-7fc9-4345-b15e-904a3efe66c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:43.524057 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad34ba-7fc9-4345-b15e-904a3efe66c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:43.524352 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad34ba-7fc9-4345-b15e-904a3efe66c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:43.524631 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad34ba-7fc9-4345-b15e-904a3efe66c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:43.534367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad34ba-7fc9-4345-b15e-904a3efe66c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:43.535802 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad34ba-7fc9-4345-b15e-904a3efe66c8 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:43.546247 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1439/2878] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:43.574081 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1304e83-fc35-449f-91b5-9eb13cf3db96 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:43.635633 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1304e83-fc35-449f-91b5-9eb13cf3db96 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:43.640667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:43.641529 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:43.641810 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:43.642087 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] PATH_INFO: `/v3/users/e159e1b807d64b43bef4768f4a77f3ab` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:43.643272 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e159e1b807d64b43bef4768f4a77f3ab)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:43.645201 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:43.813062 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e159e1b807d64b43bef4768f4a77f3ab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:43.814332 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:43.820575 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e159e1b807d64b43bef4768f4a77f3ab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:43.884772 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e159e1b807d64b43bef4768f4a77f3ab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:43.885407 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e159e1b807d64b43bef4768f4a77f3ab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:43.898224 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e159e1b807d64b43bef4768f4a77f3ab'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:43.904745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1440/2879] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:29:43 2022] DELETE /identity/v3/users/e159e1b807d64b43bef4768f4a77f3ab => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:43.909197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8eaef-465d-4859-8acb-cb33550f9b45 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:43.909492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8eaef-465d-4859-8acb-cb33550f9b45 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:43.909775 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8eaef-465d-4859-8acb-cb33550f9b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:43.927434 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-08a8eaef-465d-4859-8acb-cb33550f9b45 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:43.928681 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-08a8eaef-465d-4859-8acb-cb33550f9b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:43.987036 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1440/2880] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:43.996669 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:43.998074 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:44.063367 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894909d-a80e-42a1-8171-e2058b05e3ff admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:44.067068 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdc8e7-c7bf-4dd3-9038-86f63fb8e96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:44.067717 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdc8e7-c7bf-4dd3-9038-86f63fb8e96c service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:44.068030 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdc8e7-c7bf-4dd3-9038-86f63fb8e96c service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:44.068311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdc8e7-c7bf-4dd3-9038-86f63fb8e96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:44.077943 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdc8e7-c7bf-4dd3-9038-86f63fb8e96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:44.079381 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdc8e7-c7bf-4dd3-9038-86f63fb8e96c service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:44.088716 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1441/2881] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:44.480565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8eaef-465d-4859-8acb-cb33550f9b45 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:44.482073 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-08a8eaef-465d-4859-8acb-cb33550f9b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:44.495600 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8eaef-465d-4859-8acb-cb33550f9b45 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:44.501289 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:44.502176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:44.502463 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:44.502882 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] PATH_INFO: `/v3/projects/a9993322ec17423d8fbe57c9277e3f30` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:44.504153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9993322ec17423d8fbe57c9277e3f30)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:44.506075 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:44.593689 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9993322ec17423d8fbe57c9277e3f30', 'request_id': 'req-9137a766-00e6-4974-a9e1-0f1d31634546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:44.656152 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9993322ec17423d8fbe57c9277e3f30', 'request_id': 'req-9137a766-00e6-4974-a9e1-0f1d31634546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:44.662672 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9993322ec17423d8fbe57c9277e3f30', 'request_id': 'req-9137a766-00e6-4974-a9e1-0f1d31634546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:44.674579 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] The token cache is being invalidate because project a9993322ec17423d8fbe57c9277e3f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:29:44.674868 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:44.675497 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:44.677072 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1441/2882] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:29:44 2022] DELETE /identity/v3/projects/a9993322ec17423d8fbe57c9277e3f30 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:44.681095 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdc8e7-c7bf-4dd3-9038-86f63fb8e96c service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:44.691329 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdc8e7-c7bf-4dd3-9038-86f63fb8e96c service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:44.746527 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:44.747938 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:44.748225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:44.748502 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] PATH_INFO: `/v3/users/6c32c9e9ab49466fae8bfeace0bf8a8a` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:44.749686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c32c9e9ab49466fae8bfeace0bf8a8a)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:44.751595 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:44.933451 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c32c9e9ab49466fae8bfeace0bf8a8a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:44.940599 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c32c9e9ab49466fae8bfeace0bf8a8a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:44.999133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c32c9e9ab49466fae8bfeace0bf8a8a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:44.999713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c32c9e9ab49466fae8bfeace0bf8a8a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:45.005339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:45.012320 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-498635ab-ea87-459b-b83a-da80064239e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c32c9e9ab49466fae8bfeace0bf8a8a'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:45.018446 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1442/2883] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:29:44 2022] DELETE /identity/v3/users/6c32c9e9ab49466fae8bfeace0bf8a8a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:45.548914 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:45.556475 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:45.564145 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137a766-00e6-4974-a9e1-0f1d31634546 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:45.578462 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:45.630436 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:45.631327 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:45.631614 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:45.631915 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] PATH_INFO: `/v3/projects/c657798020b8484d9444d112118d7728` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:45.633168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c657798020b8484d9444d112118d7728)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:45.635098 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:45.783326 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c657798020b8484d9444d112118d7728', 'request_id': 'req-dcf35375-53f8-49be-9695-755c85114afb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:45.861813 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c657798020b8484d9444d112118d7728', 'request_id': 'req-dcf35375-53f8-49be-9695-755c85114afb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:45.868255 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c657798020b8484d9444d112118d7728', 'request_id': 'req-dcf35375-53f8-49be-9695-755c85114afb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:45.878932 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] The token cache is being invalidate because project c657798020b8484d9444d112118d7728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:29:45.879215 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:45.883197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dcf35375-53f8-49be-9695-755c85114afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:45.883197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1442/2884] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:29:45 2022] DELETE /identity/v3/projects/c657798020b8484d9444d112118d7728 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:45.886195 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee5ec-dad6-4977-ad73-d712315b1846 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:45.886486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee5ec-dad6-4977-ad73-d712315b1846 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:45.886764 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee5ec-dad6-4977-ad73-d712315b1846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:45.904686 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-452ee5ec-dad6-4977-ad73-d712315b1846 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:45.905875 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-452ee5ec-dad6-4977-ad73-d712315b1846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:45.965210 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1443/2885] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:45.973707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d246d9-b000-4df7-8786-1ee86424058b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:45.973993 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d246d9-b000-4df7-8786-1ee86424058b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:45.974295 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d246d9-b000-4df7-8786-1ee86424058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:45.993201 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b7d246d9-b000-4df7-8786-1ee86424058b None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:45.994759 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b7d246d9-b000-4df7-8786-1ee86424058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:46.002812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1443/2886] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:46.007045 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ee5ec-dad6-4977-ad73-d712315b1846 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.017287 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ee5ec-dad6-4977-ad73-d712315b1846 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.022113 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ffb77-07f4-4db2-b8bb-c4320d871acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.022777 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ffb77-07f4-4db2-b8bb-c4320d871acf admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.023059 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ffb77-07f4-4db2-b8bb-c4320d871acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.023333 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ffb77-07f4-4db2-b8bb-c4320d871acf admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.024091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ffb77-07f4-4db2-b8bb-c4320d871acf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:29:46.024422 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ffb77-07f4-4db2-b8bb-c4320d871acf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.026063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ffb77-07f4-4db2-b8bb-c4320d871acf admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.038754 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1444/2887] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:29:46.043022 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d246d9-b000-4df7-8786-1ee86424058b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.052782 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d246d9-b000-4df7-8786-1ee86424058b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.057511 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ee02-f665-4c55-a857-a44fe5938f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.058160 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ee02-f665-4c55-a857-a44fe5938f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.058442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ee02-f665-4c55-a857-a44fe5938f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.058719 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ee02-f665-4c55-a857-a44fe5938f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.059492 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518ee02-f665-4c55-a857-a44fe5938f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.061693 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518ee02-f665-4c55-a857-a44fe5938f81 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.161851 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1444/2888] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:29:46 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:46.165471 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ffb77-07f4-4db2-b8bb-c4320d871acf admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.175587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ffb77-07f4-4db2-b8bb-c4320d871acf admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.231371 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1c0d-18fb-4726-bac7-cb1d6121b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.232077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1c0d-18fb-4726-bac7-cb1d6121b60a admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.232362 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1c0d-18fb-4726-bac7-cb1d6121b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.232644 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1c0d-18fb-4726-bac7-cb1d6121b60a admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.233341 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b1c0d-18fb-4726-bac7-cb1d6121b60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.235315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b1c0d-18fb-4726-bac7-cb1d6121b60a admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.313358 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1445/2889] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:29:46 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:46.317707 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ee02-f665-4c55-a857-a44fe5938f81 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.329068 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ee02-f665-4c55-a857-a44fe5938f81 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.333837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97f9ae-5dc6-46f1-a6dd-eeaa521fac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.334490 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97f9ae-5dc6-46f1-a6dd-eeaa521fac5a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.334768 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97f9ae-5dc6-46f1-a6dd-eeaa521fac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.335155 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97f9ae-5dc6-46f1-a6dd-eeaa521fac5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.335901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97f9ae-5dc6-46f1-a6dd-eeaa521fac5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.337514 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97f9ae-5dc6-46f1-a6dd-eeaa521fac5a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.348821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1445/2890] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:46.352788 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1c0d-18fb-4726-bac7-cb1d6121b60a admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.362594 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1c0d-18fb-4726-bac7-cb1d6121b60a admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.367412 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873992b-d186-487c-9735-b4707b042fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.368091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873992b-d186-487c-9735-b4707b042fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.368374 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873992b-d186-487c-9735-b4707b042fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.368646 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873992b-d186-487c-9735-b4707b042fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.369357 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873992b-d186-487c-9735-b4707b042fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.370942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873992b-d186-487c-9735-b4707b042fc1 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.380684 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1446/2891] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:46.384565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97f9ae-5dc6-46f1-a6dd-eeaa521fac5a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.394872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97f9ae-5dc6-46f1-a6dd-eeaa521fac5a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.399496 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063361-54df-4e93-ba58-c2afc274046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.400416 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063361-54df-4e93-ba58-c2afc274046e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.400704 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063361-54df-4e93-ba58-c2afc274046e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.400982 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88063361-54df-4e93-ba58-c2afc274046e admin admin] PATH_INFO: `/v3/projects/d2eca3abbbe7429ea2e4109654fac145/users/c9fd1d336afe4c19a24d342507355c86/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.416216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88063361-54df-4e93-ba58-c2afc274046e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2eca3abbbe7429ea2e4109654fac145, user_id=c9fd1d336afe4c19a24d342507355c86, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.418812 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88063361-54df-4e93-ba58-c2afc274046e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.467250 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1446/2892] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:46 2022] PUT /identity/v3/projects/d2eca3abbbe7429ea2e4109654fac145/users/c9fd1d336afe4c19a24d342507355c86/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:46.477300 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69aa2d-32c7-42de-826a-2657f4979f13 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.477606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69aa2d-32c7-42de-826a-2657f4979f13 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.477900 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69aa2d-32c7-42de-826a-2657f4979f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.505887 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-be69aa2d-32c7-42de-826a-2657f4979f13 None None] MFA Rules not processed for user `c9fd1d336afe4c19a24d342507355c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:46.507175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-be69aa2d-32c7-42de-826a-2657f4979f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:46.550548 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:46.574171 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1447/2893] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:46.579339 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063361-54df-4e93-ba58-c2afc274046e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.625869 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:46.642848 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88063361-54df-4e93-ba58-c2afc274046e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.648169 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b62a71-c653-45e6-98ee-80c6081325a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.648836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b62a71-c653-45e6-98ee-80c6081325a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.649123 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b62a71-c653-45e6-98ee-80c6081325a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.649400 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b62a71-c653-45e6-98ee-80c6081325a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.650090 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b62a71-c653-45e6-98ee-80c6081325a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.652054 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b62a71-c653-45e6-98ee-80c6081325a8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.720638 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1447/2894] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:29:46 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:29:46.724670 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69aa2d-32c7-42de-826a-2657f4979f13 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.735848 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69aa2d-32c7-42de-826a-2657f4979f13 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.792564 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46a12e-babb-400b-9403-7462d3f6f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.793232 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46a12e-babb-400b-9403-7462d3f6f76b admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.793518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46a12e-babb-400b-9403-7462d3f6f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.794319 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46a12e-babb-400b-9403-7462d3f6f76b admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.795060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46a12e-babb-400b-9403-7462d3f6f76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.797021 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46a12e-babb-400b-9403-7462d3f6f76b admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.855729 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1448/2895] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:29:46 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:46.860276 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b62a71-c653-45e6-98ee-80c6081325a8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.870651 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b62a71-c653-45e6-98ee-80c6081325a8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.876662 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab9b4-7786-4fa1-881a-e4050f84c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.877315 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab9b4-7786-4fa1-881a-e4050f84c61b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.877597 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab9b4-7786-4fa1-881a-e4050f84c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.877872 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab9b4-7786-4fa1-881a-e4050f84c61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.878601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab9b4-7786-4fa1-881a-e4050f84c61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.880220 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab9b4-7786-4fa1-881a-e4050f84c61b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.891026 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1448/2896] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:46.895047 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46a12e-babb-400b-9403-7462d3f6f76b admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.905314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46a12e-babb-400b-9403-7462d3f6f76b admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:46.909988 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d7f86-015f-4b70-8f76-963a9b7cbe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:46.910858 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d7f86-015f-4b70-8f76-963a9b7cbe85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:46.911146 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d7f86-015f-4b70-8f76-963a9b7cbe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:46.911427 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d7f86-015f-4b70-8f76-963a9b7cbe85 admin admin] PATH_INFO: `/v3/projects/ebb445b95b4c487680ab812da8cc2720/users/6039a793d1164dfb8724426e2a41ae5b/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:46.928294 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d7f86-015f-4b70-8f76-963a9b7cbe85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb445b95b4c487680ab812da8cc2720, user_id=6039a793d1164dfb8724426e2a41ae5b, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:46.930944 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d7f86-015f-4b70-8f76-963a9b7cbe85 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:46.976515 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1449/2897] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:46 2022] PUT /identity/v3/projects/ebb445b95b4c487680ab812da8cc2720/users/6039a793d1164dfb8724426e2a41ae5b/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:46.980377 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab9b4-7786-4fa1-881a-e4050f84c61b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:46.991070 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab9b4-7786-4fa1-881a-e4050f84c61b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:47.047230 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aabc1-933f-466c-a0a7-1adb64689ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:47.047905 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aabc1-933f-466c-a0a7-1adb64689ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:47.048197 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aabc1-933f-466c-a0a7-1adb64689ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:47.048471 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aabc1-933f-466c-a0a7-1adb64689ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:47.049194 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aabc1-933f-466c-a0a7-1adb64689ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:47.050772 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aabc1-933f-466c-a0a7-1adb64689ad3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:47.061106 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1449/2898] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:47.065311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d7f86-015f-4b70-8f76-963a9b7cbe85 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:47.075885 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d7f86-015f-4b70-8f76-963a9b7cbe85 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:47.080520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a79b43-e0d2-4f70-8e10-8b3cc77bc816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:47.081402 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a79b43-e0d2-4f70-8e10-8b3cc77bc816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:47.081685 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a79b43-e0d2-4f70-8e10-8b3cc77bc816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:47.081967 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a79b43-e0d2-4f70-8e10-8b3cc77bc816 admin admin] PATH_INFO: `/v3/projects/ebb445b95b4c487680ab812da8cc2720/users/6039a793d1164dfb8724426e2a41ae5b/roles/741fb0bc51f64821b256dbcbb7c9413c` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:47.083963 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a79b43-e0d2-4f70-8e10-8b3cc77bc816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb445b95b4c487680ab812da8cc2720, user_id=6039a793d1164dfb8724426e2a41ae5b, role_id=741fb0bc51f64821b256dbcbb7c9413c)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:47.086592 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a79b43-e0d2-4f70-8e10-8b3cc77bc816 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:47.097348 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1450/2899] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:47 2022] PUT /identity/v3/projects/ebb445b95b4c487680ab812da8cc2720/users/6039a793d1164dfb8724426e2a41ae5b/roles/741fb0bc51f64821b256dbcbb7c9413c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:47.158275 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cdc6d-5b40-41e6-a3bc-acff3716c97e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:47.158560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cdc6d-5b40-41e6-a3bc-acff3716c97e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:47.158836 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cdc6d-5b40-41e6-a3bc-acff3716c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:47.185601 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-447cdc6d-5b40-41e6-a3bc-acff3716c97e None None] MFA Rules not processed for user `6039a793d1164dfb8724426e2a41ae5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:47.186805 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-447cdc6d-5b40-41e6-a3bc-acff3716c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:47.253547 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1450/2900] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:47.264384 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a79b43-e0d2-4f70-8e10-8b3cc77bc816 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:47.266060 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-d6a79b43-e0d2-4f70-8e10-8b3cc77bc816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:47.323352 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a79b43-e0d2-4f70-8e10-8b3cc77bc816 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:47.327600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2f567-2224-41a6-af15-3175b448e715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:47.328258 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2f567-2224-41a6-af15-3175b448e715 service cinder] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:47.328541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2f567-2224-41a6-af15-3175b448e715 service cinder] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:47.328812 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2f567-2224-41a6-af15-3175b448e715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:47.337642 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2f567-2224-41a6-af15-3175b448e715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:47.339065 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2f567-2224-41a6-af15-3175b448e715 service cinder] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:47.348663 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1451/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:47 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:47.590016 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cdc6d-5b40-41e6-a3bc-acff3716c97e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:47.599691 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cdc6d-5b40-41e6-a3bc-acff3716c97e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:47.603278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d8b1a-ff2b-484d-953c-32881bb0a2e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62bbcb039ed44749ab80bfc97dabd7b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:47.603951 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8b1a-ff2b-484d-953c-32881bb0a2e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:47.604243 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8b1a-ff2b-484d-953c-32881bb0a2e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:47.604525 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d8b1a-ff2b-484d-953c-32881bb0a2e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:47.638544 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:47.661268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8b1a-ff2b-484d-953c-32881bb0a2e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:47.662709 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d8b1a-ff2b-484d-953c-32881bb0a2e4 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:47.672536 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1451/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:53.775239 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2f567-2224-41a6-af15-3175b448e715 service cinder] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:53.815339 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:53.836468 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2f567-2224-41a6-af15-3175b448e715 service cinder] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:53.841023 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:53.841883 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:53.842166 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:53.842444 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] PATH_INFO: `/v3/users/c9fd1d336afe4c19a24d342507355c86` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:53.844520 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fd1d336afe4c19a24d342507355c86)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:53.846434 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:54.036840 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fd1d336afe4c19a24d342507355c86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.044133 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fd1d336afe4c19a24d342507355c86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.135981 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fd1d336afe4c19a24d342507355c86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.136606 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fd1d336afe4c19a24d342507355c86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.149991 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fd1d336afe4c19a24d342507355c86'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.156337 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1452/2903] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:29:53 2022] DELETE /identity/v3/users/c9fd1d336afe4c19a24d342507355c86 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:54.160929 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ae587-ffde-49f8-8a0a-232ea523cf51 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:54.161410 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ae587-ffde-49f8-8a0a-232ea523cf51 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:54.161565 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ae587-ffde-49f8-8a0a-232ea523cf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:54.179302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-093ae587-ffde-49f8-8a0a-232ea523cf51 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:54.180613 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-093ae587-ffde-49f8-8a0a-232ea523cf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:54.240050 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1452/2904] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:54.250311 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:54.251834 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:54.308436 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615af7b0-1272-4913-91f0-c7263a6e4b44 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:54.312811 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedbb46-55ef-4101-9035-4b7aaa5cf90e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:54.313457 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedbb46-55ef-4101-9035-4b7aaa5cf90e service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:54.313744 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedbb46-55ef-4101-9035-4b7aaa5cf90e service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:54.314020 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedbb46-55ef-4101-9035-4b7aaa5cf90e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:54.323046 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedbb46-55ef-4101-9035-4b7aaa5cf90e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:54.324518 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedbb46-55ef-4101-9035-4b7aaa5cf90e service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:54.334063 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1453/2905] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:29:54.680442 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ae587-ffde-49f8-8a0a-232ea523cf51 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:54.682032 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-093ae587-ffde-49f8-8a0a-232ea523cf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:54.695030 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ae587-ffde-49f8-8a0a-232ea523cf51 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:54.700223 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:54.701134 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:54.701418 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:54.701959 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] PATH_INFO: `/v3/projects/d2eca3abbbe7429ea2e4109654fac145` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:54.705043 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2eca3abbbe7429ea2e4109654fac145)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:54.707041 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:54.788620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2eca3abbbe7429ea2e4109654fac145', 'request_id': 'req-2b256773-11a0-4e25-a68a-5e52e8244a18'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.850271 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2eca3abbbe7429ea2e4109654fac145', 'request_id': 'req-2b256773-11a0-4e25-a68a-5e52e8244a18'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.856885 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2eca3abbbe7429ea2e4109654fac145', 'request_id': 'req-2b256773-11a0-4e25-a68a-5e52e8244a18'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.867628 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] The token cache is being invalidate because project d2eca3abbbe7429ea2e4109654fac145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:29:54.867940 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.868560 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:54.870082 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1453/2906] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:29:54 2022] DELETE /identity/v3/projects/d2eca3abbbe7429ea2e4109654fac145 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:54.874091 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedbb46-55ef-4101-9035-4b7aaa5cf90e service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:54.883677 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedbb46-55ef-4101-9035-4b7aaa5cf90e service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:54.940156 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:54.941029 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:54.941315 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:54.941587 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] PATH_INFO: `/v3/users/6039a793d1164dfb8724426e2a41ae5b` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:54.942757 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6039a793d1164dfb8724426e2a41ae5b)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:54.944713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:54.946199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:55.091974 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6039a793d1164dfb8724426e2a41ae5b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.099323 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6039a793d1164dfb8724426e2a41ae5b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.164934 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6039a793d1164dfb8724426e2a41ae5b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.165486 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6039a793d1164dfb8724426e2a41ae5b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.178200 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-e8fb640f-cfbf-4efd-a93f-f26e769c0729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6039a793d1164dfb8724426e2a41ae5b'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.184238 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1454/2907] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:29:54 2022] DELETE /identity/v3/users/6039a793d1164dfb8724426e2a41ae5b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:55.571588 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:55.573096 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:55.586722 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256773-11a0-4e25-a68a-5e52e8244a18 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:55.644474 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:55.645337 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:55.645621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:55.645900 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] PATH_INFO: `/v3/projects/ebb445b95b4c487680ab812da8cc2720` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:55.647168 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb445b95b4c487680ab812da8cc2720)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:55.649129 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:55.650729 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:55.743105 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb445b95b4c487680ab812da8cc2720', 'request_id': 'req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.815306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb445b95b4c487680ab812da8cc2720', 'request_id': 'req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.821847 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb445b95b4c487680ab812da8cc2720', 'request_id': 'req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.832156 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] The token cache is being invalidate because project ebb445b95b4c487680ab812da8cc2720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:29:55.832445 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.833074 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c33d493-2664-4f31-aa9e-d6b3a786b8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:29:55.834606 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1454/2908] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:29:55 2022] DELETE /identity/v3/projects/ebb445b95b4c487680ab812da8cc2720 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:55.846439 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ebb04-3407-4b17-b0f0-caac2a623bc5 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:55.846732 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ebb04-3407-4b17-b0f0-caac2a623bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:55.847041 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ebb04-3407-4b17-b0f0-caac2a623bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:55.864850 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-ae1ebb04-3407-4b17-b0f0-caac2a623bc5 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:55.866050 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-ae1ebb04-3407-4b17-b0f0-caac2a623bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:55.924424 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1455/2909] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:55.932013 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a305f3-1a8d-4968-b32a-71746d1e8930 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:55.932306 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a305f3-1a8d-4968-b32a-71746d1e8930 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:55.932582 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a305f3-1a8d-4968-b32a-71746d1e8930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:55.951320 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a7a305f3-1a8d-4968-b32a-71746d1e8930 None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:55.952530 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a7a305f3-1a8d-4968-b32a-71746d1e8930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:55.960576 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1455/2910] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:55.964713 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ebb04-3407-4b17-b0f0-caac2a623bc5 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:55.974481 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ebb04-3407-4b17-b0f0-caac2a623bc5 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:55.979157 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ddd2-49b0-4470-83b6-064df31e93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:55.979807 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ddd2-49b0-4470-83b6-064df31e93fd admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:55.980129 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ddd2-49b0-4470-83b6-064df31e93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:55.980410 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ddd2-49b0-4470-83b6-064df31e93fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:55.981139 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9ddd2-49b0-4470-83b6-064df31e93fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80314) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 12:29:55.981450 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9ddd2-49b0-4470-83b6-064df31e93fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:55.983056 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9ddd2-49b0-4470-83b6-064df31e93fd admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:55.995086 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1456/2911] 10.222.0.49 () {58 vars in 1152 bytes} [Tue Jun 28 12:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 12:29:55.999367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a305f3-1a8d-4968-b32a-71746d1e8930 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:56.009587 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a305f3-1a8d-4968-b32a-71746d1e8930 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:56.014359 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50706e-a754-4a78-902d-f81fc5a5f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:56.015040 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50706e-a754-4a78-902d-f81fc5a5f002 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:56.015367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50706e-a754-4a78-902d-f81fc5a5f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:56.015650 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50706e-a754-4a78-902d-f81fc5a5f002 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:56.016468 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50706e-a754-4a78-902d-f81fc5a5f002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:56.018367 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50706e-a754-4a78-902d-f81fc5a5f002 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:56.246621 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1456/2912] 10.222.0.49 () {60 vars in 1152 bytes} [Tue Jun 28 12:29:55 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 12:29:56.251541 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ddd2-49b0-4470-83b6-064df31e93fd admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:56.261567 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ddd2-49b0-4470-83b6-064df31e93fd admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:56.318710 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660474a-7729-478f-82b0-8cd29cdf4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:56.319383 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660474a-7729-478f-82b0-8cd29cdf4587 admin admin] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:56.319667 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660474a-7729-478f-82b0-8cd29cdf4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:56.319983 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660474a-7729-478f-82b0-8cd29cdf4587 admin admin] PATH_INFO: `/v3/users` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:56.320674 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660474a-7729-478f-82b0-8cd29cdf4587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:56.322600 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660474a-7729-478f-82b0-8cd29cdf4587 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:56.332942 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:29:56.393175 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1457/2913] 10.222.0.49 () {60 vars in 1143 bytes} [Tue Jun 28 12:29:56 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 12:29:56.397268 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50706e-a754-4a78-902d-f81fc5a5f002 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:56.407939 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50706e-a754-4a78-902d-f81fc5a5f002 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:56.412364 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f910090-ff06-4e72-bb5f-285a5a90aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:56.413278 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f910090-ff06-4e72-bb5f-285a5a90aa1e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:56.413561 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f910090-ff06-4e72-bb5f-285a5a90aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:56.413842 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f910090-ff06-4e72-bb5f-285a5a90aa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:56.414562 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f910090-ff06-4e72-bb5f-285a5a90aa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:56.416182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f910090-ff06-4e72-bb5f-285a5a90aa1e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:56.427077 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1457/2914] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 12:29:56.430862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660474a-7729-478f-82b0-8cd29cdf4587 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:56.441077 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660474a-7729-478f-82b0-8cd29cdf4587 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:56.457542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a870c-69bd-4105-8265-7df00361280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:56.457542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a870c-69bd-4105-8265-7df00361280e admin admin] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:56.457542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a870c-69bd-4105-8265-7df00361280e admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:56.457542 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a870c-69bd-4105-8265-7df00361280e admin admin] PATH_INFO: `/v3/roles` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:56.457964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a870c-69bd-4105-8265-7df00361280e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:56.457964 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a870c-69bd-4105-8265-7df00361280e admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:56.460107 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1458/2915] 10.222.0.49 () {58 vars in 1121 bytes} [Tue Jun 28 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 12:29:56.464136 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f910090-ff06-4e72-bb5f-285a5a90aa1e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:56.474620 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f910090-ff06-4e72-bb5f-285a5a90aa1e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:56.479153 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c3c34-f50d-4bf8-a375-382c53466e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:56.481989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c3c34-f50d-4bf8-a375-382c53466e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:56.481989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c3c34-f50d-4bf8-a375-382c53466e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:56.481989 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c3c34-f50d-4bf8-a375-382c53466e64 admin admin] PATH_INFO: `/v3/projects/c9a3db03a7514db3bccef79b50e057ea/users/a92354f6952943959f65baf3284d3395/roles/060d4fd81b0744fd9118c205f3961d49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:56.495216 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c3c34-f50d-4bf8-a375-382c53466e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a3db03a7514db3bccef79b50e057ea, user_id=a92354f6952943959f65baf3284d3395, role_id=060d4fd81b0744fd9118c205f3961d49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:56.497931 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c3c34-f50d-4bf8-a375-382c53466e64 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:56.576559 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1458/2916] 10.222.0.49 () {60 vars in 1482 bytes} [Tue Jun 28 12:29:56 2022] PUT /identity/v3/projects/c9a3db03a7514db3bccef79b50e057ea/users/a92354f6952943959f65baf3284d3395/roles/060d4fd81b0744fd9118c205f3961d49 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:29:56.587226 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cb2d2-7b7b-4994-a78e-d6f8bfe47205 None None] REQUEST_METHOD: `POST` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:56.589415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cb2d2-7b7b-4994-a78e-d6f8bfe47205 None None] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:56.589415 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cb2d2-7b7b-4994-a78e-d6f8bfe47205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:56.614428 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.auth.core [None req-2e2cb2d2-7b7b-4994-a78e-d6f8bfe47205 None None] MFA Rules not processed for user `a92354f6952943959f65baf3284d3395`. Rule list: `[]` (Enabled: `True`). {{(pid=80314) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:29:56.618104 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-2e2cb2d2-7b7b-4994-a78e-d6f8bfe47205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:56.679090 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1459/2917] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:29:56.691020 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c3c34-f50d-4bf8-a375-382c53466e64 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:29:56.692807 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-952c3c34-f50d-4bf8-a375-382c53466e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:29:56.749192 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c3c34-f50d-4bf8-a375-382c53466e64 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:29:56.752708 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835ceb1-c78b-429d-bdd5-83d31f79345e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6784d862961b44f48b385bec777ac439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:29:56.753596 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835ceb1-c78b-429d-bdd5-83d31f79345e service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:29:56.753896 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835ceb1-c78b-429d-bdd5-83d31f79345e service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:29:56.754171 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835ceb1-c78b-429d-bdd5-83d31f79345e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:29:56.762745 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835ceb1-c78b-429d-bdd5-83d31f79345e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:29:56.764222 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835ceb1-c78b-429d-bdd5-83d31f79345e service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:29:56.773918 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1459/2918] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:29:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:30:06.676003 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=39 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:30:06.769679 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:30:27.372918 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cb2d2-7b7b-4994-a78e-d6f8bfe47205 None None] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:30:27.438609 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cb2d2-7b7b-4994-a78e-d6f8bfe47205 None None] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:30:27.443121 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:30:27.444038 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:30:27.444324 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:30:27.444602 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] PATH_INFO: `/v3/users/a92354f6952943959f65baf3284d3395` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:30:27.446225 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92354f6952943959f65baf3284d3395)` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:30:27.448199 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:30:27.599862 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92354f6952943959f65baf3284d3395'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:27.607388 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92354f6952943959f65baf3284d3395'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:27.706368 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92354f6952943959f65baf3284d3395'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:27.707012 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92354f6952943959f65baf3284d3395'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:27.720314 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.notifications [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92354f6952943959f65baf3284d3395'} {{(pid=80314) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:27.726853 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1460/2919] 10.222.0.49 () {58 vars in 1223 bytes} [Tue Jun 28 12:30:27 2022] DELETE /identity/v3/users/a92354f6952943959f65baf3284d3395 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:30:27.731945 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe2ae-cac9-47d0-9c40-94f9e2b18ecd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:30:27.732435 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe2ae-cac9-47d0-9c40-94f9e2b18ecd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:30:27.732542 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe2ae-cac9-47d0-9c40-94f9e2b18ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:30:27.750901 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-04efe2ae-cac9-47d0-9c40-94f9e2b18ecd None None] MFA Rules not processed for user `5dacf821834c434a822a5d4f64c8fbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 12:30:27.758814 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04efe2ae-cac9-47d0-9c40-94f9e2b18ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:30:27.816933 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1460/2920] 10.222.0.49 () {58 vars in 957 bytes} [Tue Jun 28 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 12:30:27.828231 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:30:27.829661 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:30:27.889995 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff59db0-b8aa-412e-8660-b3c9220b9d04 admin admin] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:30:27.893825 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0887d1-345a-4d63-8b24-53d2604ff6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ff61c1fbdf34fa38588e4cd2cdc5398', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:30:27.900532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0887d1-345a-4d63-8b24-53d2604ff6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:30:27.900532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0887d1-345a-4d63-8b24-53d2604ff6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:30:27.900532 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0887d1-345a-4d63-8b24-53d2604ff6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:30:27.906301 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0887d1-345a-4d63-8b24-53d2604ff6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:30:27.907791 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0887d1-345a-4d63-8b24-53d2604ff6c1 service neutron] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:30:27.918147 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1461/2921] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:30:28.337302 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efe2ae-cac9-47d0-9c40-94f9e2b18ecd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:30:28.338837 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04efe2ae-cac9-47d0-9c40-94f9e2b18ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:30:28.354593 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efe2ae-cac9-47d0-9c40-94f9e2b18ecd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:30:28.355815 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dacf821834c434a822a5d4f64c8fbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34e93c67d4cd4a79a4295c88eb6ac57a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:30:28.356821 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:30:28.357113 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:30:28.357394 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] PATH_INFO: `/v3/projects/c9a3db03a7514db3bccef79b50e057ea` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:30:28.358711 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a3db03a7514db3bccef79b50e057ea)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:30:28.360810 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:30:28.474176 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a3db03a7514db3bccef79b50e057ea', 'request_id': 'req-934214c3-1312-4d67-b191-ef5942dcba3c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:28.557773 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a3db03a7514db3bccef79b50e057ea', 'request_id': 'req-934214c3-1312-4d67-b191-ef5942dcba3c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:28.564777 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a3db03a7514db3bccef79b50e057ea', 'request_id': 'req-934214c3-1312-4d67-b191-ef5942dcba3c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:28.575173 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] The token cache is being invalidate because project c9a3db03a7514db3bccef79b50e057ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 12:30:28.575457 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:28.576120 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-934214c3-1312-4d67-b191-ef5942dcba3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 12:30:28.577705 dv-cinder-847954-1-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1461/2922] 10.222.0.49 () {58 vars in 1232 bytes} [Tue Jun 28 12:30:28 2022] DELETE /identity/v3/projects/c9a3db03a7514db3bccef79b50e057ea => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 12:30:37.913525 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:30:38.572182 dv-cinder-847954-1-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 12:33:10.051625 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0887d1-345a-4d63-8b24-53d2604ff6c1 service neutron] Authenticating user token {{(pid=80314) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 12:33:10.053101 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-da0887d1-345a-4d63-8b24-53d2604ff6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:33:10.120999 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0887d1-345a-4d63-8b24-53d2604ff6c1 service neutron] Validating token access rules against request {{(pid=80314) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 12:33:10.179510 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2aff8-bb44-4540-a651-7476b81f9c7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7db581dec064fe0afeb4be5838470bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e94ab17538894fe6bdae6933e33526fc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80314) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 12:33:10.180185 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2aff8-bb44-4540-a651-7476b81f9c7f service placement] REQUEST_METHOD: `GET` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 12:33:10.180470 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2aff8-bb44-4540-a651-7476b81f9c7f service placement] SCRIPT_NAME: `/identity` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 12:33:10.180745 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2aff8-bb44-4540-a651-7476b81f9c7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80314) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 12:33:10.182547 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.fernet_utils [None req-90e2aff8-bb44-4540-a651-7476b81f9c7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80314) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 12:33:10.198016 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2aff8-bb44-4540-a651-7476b81f9c7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 12:33:10.199593 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2aff8-bb44-4540-a651-7476b81f9c7f service placement] RBAC: Authorization granted {{(pid=80314) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 12:33:10.210250 dv-cinder-847954-1-smb devstack@keystone.service[80314]: [pid: 80314|app: 0|req: 1462/2923] 10.222.0.49 () {60 vars in 1365 bytes} [Tue Jun 28 12:33:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 12:33:20.205980 dv-cinder-847954-1-smb devstack@keystone.service[80314]: DEBUG dbcounter [-] [80314] Writing DB stats keystone:SELECT=58 {{(pid=80314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}